-- Logs begin at Thu 2022-05-26 15:44:16 UTC, end at Thu 2022-05-26 17:24:16 UTC. -- May 26 16:47:26.215480 dv-cinder-836072-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 16:47:26.223227 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 16:47:26.225193 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 16:47:26 2022] *** May 26 16:47:26.225193 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 16:47:26.225193 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 16:47:26.225193 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: nodename: dv-cinder-836072-5-iscsi May 26 16:47:26.225193 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: machine: x86_64 May 26 16:47:26.225193 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: clock source: unix May 26 16:47:26.225193 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: pcre jit disabled May 26 16:47:26.225193 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: detected number of CPU cores: 4 May 26 16:47:26.225745 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: current working directory: / May 26 16:47:26.225745 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: detected binary path: /usr/bin/uwsgi-core May 26 16:47:26.225745 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: your processes number limit is 47680 May 26 16:47:26.225745 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: your memory page size is 4096 bytes May 26 16:47:26.225745 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: detected max file descriptor number: 2048 May 26 16:47:26.225745 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: lock engine: pthread robust mutexes May 26 16:47:26.225745 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: thunder lock: enabled May 26 16:47:26.225745 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 16:47:26.225745 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 16:47:26.272656 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: Python main interpreter initialized at 0x561490d869c0 May 26 16:47:26.272656 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: python threads support enabled May 26 16:47:26.272656 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: your server socket listen backlog is limited to 100 connections May 26 16:47:26.272656 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: your mercy for graceful operations on workers is 90 seconds May 26 16:47:26.273086 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: mapped 403077 bytes (393 KB) for 2 cores May 26 16:47:26.273164 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: *** Operational MODE: preforking *** May 26 16:47:26.273370 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: *** uWSGI is running in multiple interpreter mode *** May 26 16:47:26.273370 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: spawned uWSGI master process (pid: 115581) May 26 16:47:26.273577 dv-cinder-836072-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 16:47:26.274157 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: spawned uWSGI worker 1 (pid: 115582, cores: 1) May 26 16:47:26.274495 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: spawned uWSGI worker 2 (pid: 115583, cores: 1) May 26 16:47:26.274662 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 16:47:27.448382 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 16:47:27.470859 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 16:47:28.178381 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:47:28.178381 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: from cryptography.utils import int_from_bytes May 26 16:47:28.178755 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:47:28.178755 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: from cryptography.utils import int_from_bytes May 26 16:47:28.191619 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:47:28.191619 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: from cryptography.utils import int_from_bytes May 26 16:47:28.191951 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:47:28.191951 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: from cryptography.utils import int_from_bytes May 26 16:47:30.791072 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:47:30.791646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:47:30.791851 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:47:30.792216 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:47:30.792474 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:47:30.792865 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.793194 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.793519 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.793842 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.794176 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.794518 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.794842 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.795167 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.795499 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.795763 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.796081 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.796409 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836072-5-iscsi {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.796732 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.797042 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.797356 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.797676 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.797983 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.798307 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.798640 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.799209 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.799758 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.800075 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.800396 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.800743 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.801069 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.801383 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.801708 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.802021 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.802366 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.802684 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.803087 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836072-5-iscsi {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.803409 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.803727 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.804047 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.804475 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.804789 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.805101 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.805425 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.805567 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:47:30.805973 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.806067 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:47:30.806147 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.806373 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:47:30.806505 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.806705 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.806822 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:47:30.806990 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:47:30.807094 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.807335 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.807429 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.807638 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.807744 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.807948 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.808071 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.808260 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.808609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.808836 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.808932 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.809145 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.809230 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.809450 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.809535 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.809701 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.809793 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.810010 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.810127 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.810354 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.810460 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.810675 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.810764 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.811000 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.811086 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836072-5-iscsi {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.811254 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.811350 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.811506 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.811645 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.811827 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.811959 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.812151 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.812279 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.812462 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.812586 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.812771 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.812909 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.813081 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.813216 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.813388 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.813698 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.813813 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.814005 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.814100 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.814336 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.814467 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.814656 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.814757 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.815509 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.815662 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.815819 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.815968 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.816180 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.816283 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.816515 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.816654 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.816844 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.816967 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.817229 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.817324 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.112 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.817482 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.112 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.817570 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.817792 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.817928 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836072-5-iscsi {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.818135 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.818248 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.818484 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.818586 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.818795 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.818883 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.819118 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.819303 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.819441 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.819619 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.819747 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.819929 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.820048 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.820251 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.820344 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.820576 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.820674 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.820886 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.820981 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.821218 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.821321 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.821514 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.821601 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.821821 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.821927 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.822129 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.822223 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.822474 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.822566 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.822787 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.822886 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.823097 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.823192 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.823405 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.823501 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.823708 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.823794 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.824018 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.824122 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.824267 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.824351 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.824578 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.824668 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.824903 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.824999 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.825213 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.825297 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.825518 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.825604 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.825774 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.825873 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.826026 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.826156 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.826365 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.826489 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.826690 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.826810 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.826998 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.827133 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.827307 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.827441 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.827618 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.827747 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.827925 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.828054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.828233 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.828361 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.828544 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.828710 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.828858 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.828995 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.829132 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.829265 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.829456 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.829614 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.829772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.829913 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.830094 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.830238 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.830488 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.831189 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.831404 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.831493 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.831729 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.832049 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.112 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.832144 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.832365 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.112 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.832517 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.832681 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.832802 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.833013 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.833101 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.833339 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.833426 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.833653 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.833782 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.833956 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.834049 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.834267 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.834514 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.834707 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.834859 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.834994 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.835129 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.835261 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.835389 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.835520 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.835668 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.835805 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.835933 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.836088 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.836176 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.836360 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.836518 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.836654 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.836822 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.836958 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.837141 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.837280 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.837433 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.837577 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.837695 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.837864 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.838019 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.838179 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.838345 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.838505 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.838637 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.838794 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.838915 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.839101 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.839251 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.839419 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.839592 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.839736 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.839917 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.840076 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.840219 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.840351 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.840542 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.840642 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.840866 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.840962 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.841180 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.841266 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.841495 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.841622 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.841812 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.841943 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.842122 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.842275 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.842441 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.842548 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.842744 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.842843 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.843051 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.843139 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.843372 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.843458 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.843678 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.843765 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.843983 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.844069 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.844302 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.844387 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.844607 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.844748 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.844913 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.845000 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.845232 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.845317 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.845540 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.845626 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.845849 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.845935 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.846772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.846913 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.847056 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.847173 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.847425 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.847509 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.847679 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.847880 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.847996 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.848198 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.848324 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.848511 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.848622 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.848822 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.848958 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.849132 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.849274 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.849447 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.849606 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.849738 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.849909 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.850049 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.850224 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.850377 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.850562 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.850684 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.850875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.851007 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.851188 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.851331 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.851527 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.851645 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.851847 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.851953 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.852166 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.852252 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.852479 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.852576 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:47:30.852797 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.852889 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.853109 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.853215 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.853420 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.853562 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.853733 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.853878 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.854038 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.854213 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.854364 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.854574 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.854659 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.854897 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.854993 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.855212 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.855308 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.855528 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.855613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.855857 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.855942 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.856171 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.856265 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.856484 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.856576 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.856800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.856885 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.857116 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.857218 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.857427 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.857513 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.857738 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.857824 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.858046 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.858132 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.858382 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.858481 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.858697 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.858783 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.859006 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.859144 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.859327 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.859412 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.859637 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.859722 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.859945 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.860030 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.860266 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.860356 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.860571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.860664 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.860877 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.860964 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.861191 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.861277 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.861503 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.861597 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.862498 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.862596 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.862818 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.862905 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.863134 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.863239 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.863460 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.863546 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.863775 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.863860 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.864091 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.864184 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.864410 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.864494 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.864735 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.864820 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.865049 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.865154 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.865360 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.865446 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.865674 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.865765 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.865992 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.866081 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.866297 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.866432 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.866637 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.866724 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.866945 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.867032 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.867252 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.867349 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.867560 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.867651 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.867872 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.867964 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.868178 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.868271 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.868485 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.868570 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.868790 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.868875 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.869096 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.869180 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.869400 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.869496 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.869705 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.869788 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.870015 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.870100 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.870338 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.870436 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.870643 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.870728 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.870949 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.871044 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.871279 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.871376 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.871590 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.871674 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.871908 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.872001 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.872221 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.872316 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.872534 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.872626 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.872846 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.872931 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.873156 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.873242 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.873468 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.873560 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.873780 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.873864 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.874086 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.874173 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.874429 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.874516 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.874744 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.874839 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.875053 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.875147 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.875368 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.875451 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.875672 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.875755 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.875978 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.876073 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.876295 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.876386 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.876606 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.876701 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.876920 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.877011 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.877232 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.877319 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.877623 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.877787 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.877973 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.878058 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.878292 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.878508 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.878634 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.878836 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.878970 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.879165 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.879310 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.879480 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.879618 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.879799 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.879944 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.880113 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.880270 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.880425 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.880589 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.880739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.880895 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.881052 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.881207 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.881375 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.881516 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.881688 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.881825 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.882013 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.882132 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.882369 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.882477 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.882674 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.882767 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.882989 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.883074 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.883312 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.883406 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.883620 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.883713 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.883936 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.884021 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.884257 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.884348 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.884570 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.884655 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.884875 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.884960 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.885181 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.885274 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.885486 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.885572 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.885798 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.885882 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.886111 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.886196 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.886457 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.886545 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.886768 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.886854 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.887076 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.887169 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.887387 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.887473 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.887703 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.887797 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.888015 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.888100 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.888328 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.888413 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.888635 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.888728 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.888948 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.889032 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.889255 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.889345 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.889562 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.889656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.889867 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.889953 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.890179 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.890264 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.890517 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.890615 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.890829 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.890913 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.891144 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.891228 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.891464 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.891560 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.891770 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.891854 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.892079 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.892200 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.892402 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.892498 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.892712 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.892810 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.893052 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.893209 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.893506 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.893669 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.893818 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.893942 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.894137 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.894299 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.894483 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.894638 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.894801 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.894950 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.895115 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.895280 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.895444 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.895591 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.895726 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.895904 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.896042 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.896262 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.896397 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.896536 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.896669 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.896823 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.896954 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.897148 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.897292 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.897470 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.897581 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.897782 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.897870 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.898095 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.898190 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.898434 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.898532 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.898749 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.898835 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.899061 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.899150 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.899387 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.899486 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.899698 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.899798 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.900009 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.900103 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.900322 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.900410 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.900629 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.900725 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.900938 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.901032 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.901250 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.901338 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.901564 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.901829 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.901925 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.902164 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.902262 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.902503 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.902605 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.902815 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.902902 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.903134 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.903221 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.903446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.903546 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.903754 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.903842 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.904060 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.904146 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.904372 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.904472 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.904696 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.904795 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.905008 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.905095 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.905343 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.905428 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.905637 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.905733 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.905940 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.906027 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.906246 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.906371 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.906580 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.906669 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.906888 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.906976 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.907192 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.907277 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.907501 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.907650 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.907790 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.907935 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.908099 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.908228 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.908406 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.909025 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.909246 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.909377 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.909556 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.909784 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.910038 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.910169 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.910298 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.910446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.910540 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.910745 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.910832 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.911060 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.911153 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.911374 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.911459 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.911678 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.911771 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.912003 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.912086 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.912318 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.912403 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.912630 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.912716 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.912944 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.913030 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.913257 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.913352 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.913569 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.913663 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.913889 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.913988 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.914200 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.914301 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.914537 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.914631 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.914844 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.914929 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.915148 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.915240 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.915531 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.915628 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.915772 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.915858 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.916079 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.916340 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.916433 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.916673 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.916765 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.916987 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.917080 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.917300 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.917385 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.917606 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.917690 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.917916 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.918010 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.918220 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.918306 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.918561 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.918647 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.918873 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.918969 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.919180 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.919278 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.919485 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.919610 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.919797 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.919890 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.920104 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.920189 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.920405 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.920488 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.920711 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.920794 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.921013 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.921107 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.921319 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.921403 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.921623 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.921718 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.921928 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.922012 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.922235 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.922339 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.922569 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.922678 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.922872 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.922963 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.923175 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.923259 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.923483 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.923580 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.923797 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.923882 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.924101 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.925033 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.925142 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.925260 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.925372 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.925483 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.925675 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.925793 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.925939 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.926071 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.926257 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.926366 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.926624 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.926710 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.926945 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.927032 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.927251 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.927345 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.927562 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.927648 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.927870 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.927959 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.928179 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.928265 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.928483 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.928568 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.928794 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.928880 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.929100 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.929186 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.929404 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.929502 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.929708 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.929801 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.930014 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.930100 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.930344 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.930445 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.930660 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.930746 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.930969 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.931054 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.931274 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.931369 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.931581 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.931667 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.931884 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.931970 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.932188 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.932280 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.932502 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.932594 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.932810 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.932897 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.933128 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.933214 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.933697 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.933788 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.934004 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.934090 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.934308 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.934422 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.934642 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.934728 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.934956 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.935040 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.935262 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.935346 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.935573 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.935658 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.935882 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.935986 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.936190 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.936275 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.936494 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.936586 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.936798 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.936882 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.937103 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.937189 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.937415 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.937501 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.937723 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.937817 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.938028 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.938121 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.938373 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.938463 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.938688 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.938785 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.938994 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.939080 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.939300 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.939384 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.939608 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.939705 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.940068 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.940195 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.940340 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.940435 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.940617 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.940816 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.940972 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.941144 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.941290 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.941465 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.941604 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.941775 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.941918 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.942090 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.942231 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.942421 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.942564 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.942734 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.942877 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.943042 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.943191 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.943354 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.943502 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.943660 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.943830 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.943966 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.944143 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.944272 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.944453 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.944578 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.944765 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.944882 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.945089 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.945205 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.945389 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.945514 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.945697 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.945816 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.946112 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.946211 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.946440 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.946532 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.946759 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.946846 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.947069 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.947167 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.947381 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.947473 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.947696 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.947789 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.948017 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.948122 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.948330 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.948415 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.948639 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.948725 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.948952 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.949045 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.949267 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.949352 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.949580 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.949672 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.949900 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.950021 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.950212 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.950372 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.950551 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.950650 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.950858 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.950960 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.951163 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.951248 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.951486 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.951571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.951793 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.951879 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.952101 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.952187 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.952423 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.952516 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.952731 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.952818 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.953054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.953146 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.953359 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.953473 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.953671 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.953789 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.953982 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.954097 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.954291 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.954539 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.954628 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.954856 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.954943 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.955170 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.955256 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.956033 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.956294 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.956476 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.956673 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.956776 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.956979 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.957075 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.957295 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.957386 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.957606 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.957697 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.957923 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.958025 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.958241 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.958356 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.958576 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.958670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.958891 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.958989 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.959199 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.959286 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.959505 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.959596 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.959817 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.959904 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.960130 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.960237 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.960444 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.960555 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.960750 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.960890 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.961169 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.961254 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.961483 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.961577 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.961796 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.961880 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.962107 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.962201 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.962440 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.962541 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.962749 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.962836 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.963063 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.963149 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.963371 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.963466 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.963679 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.963770 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.964003 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.964108 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.964312 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.964428 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.964625 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.964745 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.964938 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.965061 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.965250 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.965373 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.965557 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.965683 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.965870 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.965996 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.966197 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.966312 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.966530 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.966638 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.966854 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.966951 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.967170 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.967267 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.967495 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.967592 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.967820 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.967916 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.968127 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.968230 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.968449 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.968553 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.968760 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.968856 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.969065 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.969174 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.969374 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.969573 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.969669 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.969890 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.970015 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.970210 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.970343 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.970568 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.970665 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.970895 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.970981 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.971299 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.971395 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.971611 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.971697 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.971929 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.972016 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.972245 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.972332 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.972573 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.972667 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.972957 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.973050 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.973285 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.973370 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.973596 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.973681 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.973903 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.973997 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.974215 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.974308 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.974556 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.974644 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.974866 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.974961 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.975173 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.975258 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.975484 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.975599 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.975795 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.975927 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.976101 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.976240 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.976405 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.976554 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.976729 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.976883 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.977038 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.977194 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.977362 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.977503 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.977676 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.977818 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.977983 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.978127 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.978292 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.978464 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.978622 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.978776 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.978968 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.979086 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.979279 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.979401 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.979616 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.979711 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.979936 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.980022 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.980260 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.980353 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.980592 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.980709 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.980905 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.981003 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.981215 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.981321 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.981534 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.981630 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.981850 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.981945 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.982165 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.982274 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.982573 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.982671 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.982888 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.982985 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.983202 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.983299 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.983514 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.983600 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.983822 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.983908 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.984132 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.984219 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.984443 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.984531 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.984757 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.984844 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.985087 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.985287 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.985410 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.985623 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.985741 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.985939 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.986070 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.986259 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.986409 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.986600 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.987258 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.987539 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.987642 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.987932 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.988020 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.988264 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.988349 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.988581 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.988678 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.988887 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.988972 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.989196 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.989281 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.989511 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.989598 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.989821 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.989907 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.990132 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.990217 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.990462 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.990565 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.990781 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.990876 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.991088 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.991182 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.991393 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.991479 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.991697 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.991782 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.992019 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.992152 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.992325 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.992411 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.992648 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.992734 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.992960 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.993046 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.993266 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.993351 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.993575 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.993660 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.993881 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.993968 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.994191 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.994283 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.994532 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.994619 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.994853 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.994947 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.995168 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.995254 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.995482 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.995566 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.995800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.995887 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.996110 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.996194 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.996434 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.996526 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.996750 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.996846 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.997067 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.997153 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.997382 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.997480 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.997697 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.997781 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.998009 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.998094 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.998348 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.998554 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.998686 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.998873 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.998959 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.999211 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.999297 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.999540 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.999628 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.999862 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:30.999946 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.000181 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.000392 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.000485 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.000727 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.000819 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.001045 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.001139 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.001360 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.001446 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.001672 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.001758 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.001986 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.002072 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.002369 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.002462 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.002688 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.002856 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.003103 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.003197 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.003287 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.003474 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.003600 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.003799 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.003986 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.004116 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.004329 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.004658 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.004745 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.004996 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.005081 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.005317 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.005404 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.005636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.005734 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.005953 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.006046 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.006271 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.006372 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.006606 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.006699 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.006933 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.007106 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.007243 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.007330 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.007553 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.007639 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.007867 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.007960 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.008181 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.008266 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.008491 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.008584 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.008800 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.008893 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.009112 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.009197 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.009426 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.009510 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.009730 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.009822 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.010037 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.010123 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.010361 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.010450 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.010685 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.010772 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.010994 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.011085 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.011303 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.011389 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.011611 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.011697 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.011923 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.012009 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.012231 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.012326 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.012539 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.012626 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.012848 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.013064 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.013149 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.013383 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.013470 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.013722 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.013808 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.014040 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.014124 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.014384 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.014504 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.014707 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.014809 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.015016 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.015113 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.015328 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.015425 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.015640 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.015736 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.015953 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.016091 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.016267 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.016365 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.016581 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.016681 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.016887 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.016982 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.017197 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.017289 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.017516 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.017601 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.017824 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.018463 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.018687 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.018782 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.019004 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.019099 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.019366 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.019585 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.019904 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.019991 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.020241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.020326 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.020565 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.020651 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.020899 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.020986 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.021229 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.021331 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.021536 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.021622 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.021844 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.021938 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.022154 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.022239 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.022492 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.022580 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.022806 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.022894 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.023120 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.023218 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.023427 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.023512 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.023735 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.023821 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.024047 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.024141 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.024357 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.024442 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.024664 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.024750 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.024973 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.025066 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.025278 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.025371 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.025585 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.025670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.025898 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.025997 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.026206 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.026299 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.026541 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.026629 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.026857 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.027017 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.027165 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.027252 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.027475 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.027560 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.027782 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.027868 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.028091 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.028177 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.028407 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.028492 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.028715 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.028803 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.029024 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.029116 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.029330 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.029415 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.029638 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.029723 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.029944 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.030028 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.030256 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.030373 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.030601 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.030687 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.030909 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.030995 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.031251 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.031343 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.031557 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.031643 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.031877 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.031970 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.032189 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.032283 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.032514 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.032600 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.032828 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.032920 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.033142 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.033229 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.033467 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.033639 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.033873 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.033957 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.034250 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.034436 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.034609 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.034774 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.034953 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.035097 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.035291 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.035513 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.035610 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.035847 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.035933 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.036158 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.036252 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.036470 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.036562 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.036781 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.036867 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.037108 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.037204 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.037417 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.037503 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.037726 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.037811 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.038034 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.038129 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.038362 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.038451 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.038671 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.038755 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.038979 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.039118 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.039288 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.039383 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.039593 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.039687 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.039900 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.040012 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.040204 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.040295 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.040508 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.040602 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.040813 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.040899 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.041164 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.041252 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.041425 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.041537 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.041729 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.041815 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.042039 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.042134 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.042371 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.042471 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.042684 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.042770 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.042989 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.043074 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.043295 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.043382 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.043601 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.043686 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.043910 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.043995 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.044223 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.044309 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.044541 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.044626 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.044868 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.044953 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.045178 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.045265 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.045486 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.045570 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.045797 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.045894 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.046123 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.046216 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.046473 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.046563 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.046791 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.046889 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.047103 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.047241 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.047435 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.047521 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.047747 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.047842 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.048061 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.048147 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.048373 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.048459 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.048686 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.048779 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.048997 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.049083 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.049875 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.050019 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.050216 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.050360 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.050570 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.050656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.050882 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.051042 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.051212 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.051357 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.051534 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.051674 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.051856 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.051990 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.052175 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.052314 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.052489 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.052627 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.052821 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.052919 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.053135 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.053230 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.053448 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.053534 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.053765 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.053859 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.054075 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.054172 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.054412 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.054504 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.054726 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.054832 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.055041 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.055136 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.055346 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.055431 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.055654 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.055741 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.055962 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.056047 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.056269 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.056354 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.056578 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.056671 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.056883 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.056969 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.057194 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.057328 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.057499 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.057587 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.057806 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.057892 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.058108 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.058193 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.058693 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.058787 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.059001 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.059101 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.059307 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:47:31.059407 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.059655 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.059972 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.060297 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.060610 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.060936 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.061248 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.061576 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.061900 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.062217 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.062571 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.062908 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.063222 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.063536 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.063850 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.064163 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.064475 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.064856 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.065780 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.066116 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.066524 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.066861 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.067182 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.067505 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.067824 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.068140 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.068475 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.068788 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.069101 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.069419 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.069730 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.070043 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.070384 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.070704 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.071034 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.071372 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.071689 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.072020 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.072351 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.072702 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.073019 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.073366 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.073700 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.074046 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.074432 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.074744 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:47:31.074991 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:47:31.118344 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO dbcounter [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Registered counter for database nova_api May 26 16:47:31.134371 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO dbcounter [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] Registered counter for database nova_api May 26 16:47:31.140041 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_db.sqlalchemy.engines [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:47:31.146995 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writer thread running {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:47:31.153718 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG oslo_db.sqlalchemy.engines [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:47:31.160459 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG dbcounter [-] [115582] Writer thread running {{(pid=115582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:47:31.204878 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.context [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e260859a-6023-4cf2-a86b-d32d2bdb7fbd(cell1) {{(pid=115583) load_cells /opt/stack/nova/nova/context.py:464}} May 26 16:47:31.209689 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:31.211310 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:31.212138 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:31.214113 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:31.216475 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO dbcounter [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Registered counter for database nova_cell0 May 26 16:47:31.218908 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.context [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e260859a-6023-4cf2-a86b-d32d2bdb7fbd(cell1) {{(pid=115582) load_cells /opt/stack/nova/nova/context.py:464}} May 26 16:47:31.220497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO dbcounter [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Registered counter for database nova_cell1 May 26 16:47:31.223104 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG oslo_concurrency.lockutils [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:31.227744 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG oslo_concurrency.lockutils [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:31.227744 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG oslo_concurrency.lockutils [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:31.227744 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG oslo_concurrency.lockutils [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:31.228475 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_db.sqlalchemy.engines [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:47:31.229608 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO dbcounter [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] Registered counter for database nova_cell0 May 26 16:47:31.231961 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_db.sqlalchemy.engines [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:47:31.233659 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO dbcounter [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] Registered counter for database nova_cell1 May 26 16:47:31.234967 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writer thread running {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:47:31.241489 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG oslo_db.sqlalchemy.engines [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:47:31.243108 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG oslo_db.sqlalchemy.engines [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:47:31.248588 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG dbcounter [-] [115582] Writer thread running {{(pid=115582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:47:31.251155 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG dbcounter [-] [115582] Writer thread running {{(pid=115582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:47:31.376614 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writer thread running {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:47:31.386457 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO dbcounter [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Registered counter for database nova_cell0 May 26 16:47:31.393439 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_db.sqlalchemy.engines [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:47:31.397914 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writer thread running {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:47:31.399549 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO dbcounter [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] Registered counter for database nova_cell0 May 26 16:47:31.405899 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG oslo_db.sqlalchemy.engines [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:47:31.411192 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG dbcounter [-] [115582] Writer thread running {{(pid=115582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:47:31.837454 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: WARNING keystonemiddleware.auth_token [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:47:31.844642 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: WARNING keystonemiddleware.auth_token [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:47:32.009756 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: WARNING keystonemiddleware.auth_token [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:47:32.017043 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: WARNING keystonemiddleware.auth_token [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:47:32.189000 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: WARNING keystonemiddleware.auth_token [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:47:32.195498 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: WARNING keystonemiddleware.auth_token [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:47:32.200752 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561490d869c0 pid: 115583 (default app) May 26 16:47:32.202866 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:32.204043 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] 10.222.0.112 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001782 May 26 16:47:32.204449 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 1/1] 10.222.0.112 () {50 vars in 793 bytes} [Thu May 26 16:47:32 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:47:32.357784 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: WARNING keystonemiddleware.auth_token [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:47:32.364005 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: WARNING keystonemiddleware.auth_token [None req-e953b2af-ae62-44ff-9150-49752f6f5acf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:47:32.369268 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561490d869c0 pid: 115582 (default app) May 26 16:48:56.713697 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:56.714713 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001409 May 26 16:48:56.715128 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 2/2] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:48:56 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:48:56.727562 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG dbcounter [-] [115582] Writing DB stats nova_api:SELECT=3 {{(pid=115582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:56.728641 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG dbcounter [-] [115582] Writing DB stats nova_cell0:SELECT=3 {{(pid=115582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:56.729657 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG dbcounter [-] [115582] Writing DB stats nova_cell1:SELECT=3 {{(pid=115582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:56.730682 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG dbcounter [-] [115582] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:57.181228 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-f567a489-aee0-4870-b4a7-38267a65e0d4 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:57.217225 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-f567a489-aee0-4870-b4a7-38267a65e0d4 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.495098 May 26 16:48:57.218123 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 1/3] 10.222.0.112 () {60 vars in 1296 bytes} [Thu May 26 16:48:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:59.668450 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:59.670431 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-f49b4630-db94-416d-af83-b7826eb9fb57 None None] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002626 May 26 16:48:59.671802 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 3/4] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:48:59 2022] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:48:59.735112 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-b94c7b40-b726-475e-bd7f-1e5983538ef7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "name": "cirros256"}} {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:59.754641 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:48:59.754641 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: warnings.warn(msg) May 26 16:48:59.848699 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-b94c7b40-b726-475e-bd7f-1e5983538ef7 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.168413 May 26 16:48:59.849334 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 2/5] 10.222.0.112 () {64 vars in 1287 bytes} [Thu May 26 16:48:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:48:59.864249 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_api:SELECT=3 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:59.867705 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_cell1:SELECT=3 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:59.867705 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_cell0:SELECT=3 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:59.867705 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:00.074621 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-8dfc82e2-310d-45e4-8d8e-85f604014110 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:00.076993 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:49:00.076993 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: warnings.warn(msg) May 26 16:49:00.242110 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-8dfc82e2-310d-45e4-8d8e-85f604014110 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.382998 May 26 16:49:00.242721 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 4/6] 10.222.0.112 () {64 vars in 1340 bytes} [Thu May 26 16:48:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:02.565308 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-b94c7b40-b726-475e-bd7f-1e5983538ef7 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:02.566315 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-b94c7b40-b726-475e-bd7f-1e5983538ef7 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001458 May 26 16:49:02.566731 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 3/7] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:49:02 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:02.680976 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-9b183f18-2e6e-4782-b66e-de1aeba4f264 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:02.700101 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:49:02.700101 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: warnings.warn(msg) May 26 16:49:02.815675 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-9b183f18-2e6e-4782-b66e-de1aeba4f264 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.242880 May 26 16:49:02.816969 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 5/8] 10.222.0.112 () {64 vars in 1287 bytes} [Thu May 26 16:49:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:49:02.829919 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-f1514cce-0393-4923-9949-ccb74ab1a6f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:02.831442 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:49:02.831442 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: warnings.warn(msg) May 26 16:49:02.972164 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-f1514cce-0393-4923-9949-ccb74ab1a6f3 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.145841 May 26 16:49:02.972814 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 4/9] 10.222.0.112 () {64 vars in 1340 bytes} [Thu May 26 16:49:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:05.319751 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-9b183f18-2e6e-4782-b66e-de1aeba4f264 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:05.320775 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-9b183f18-2e6e-4782-b66e-de1aeba4f264 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001481 May 26 16:49:05.321423 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 6/10] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:49:05 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:05.383103 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-1136c04d-fce5-4f08-8f68-e723611ec74e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "ram": 1024}} {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:05.465146 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-1136c04d-fce5-4f08-8f68-e723611ec74e admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.137078 May 26 16:49:05.470465 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 5/11] 10.222.0.112 () {64 vars in 1287 bytes} [Thu May 26 16:49:05 2022] POST /compute/v2.1/flavors => generated 406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:49:05.478227 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-6706a3b8-ce90-41d8-bcf1-248d211011ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:05.559519 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-6706a3b8-ce90-41d8-bcf1-248d211011ad admin admin] 10.222.0.112 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085424 May 26 16:49:05.560452 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 7/12] 10.222.0.112 () {64 vars in 1340 bytes} [Thu May 26 16:49:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:07.866051 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-1136c04d-fce5-4f08-8f68-e723611ec74e admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:07.867236 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-1136c04d-fce5-4f08-8f68-e723611ec74e admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001637 May 26 16:49:07.867907 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 6/13] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:49:07 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:07.930556 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-e456ef62-7341-4550-a85a-317af4e3922b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:08.015559 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-e456ef62-7341-4550-a85a-317af4e3922b admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.141443 May 26 16:49:08.016130 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 8/14] 10.222.0.112 () {64 vars in 1287 bytes} [Thu May 26 16:49:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:49:08.028531 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-81d9efbf-6f10-429b-b914-0f6d8ff3b428 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:08.203072 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-81d9efbf-6f10-429b-b914-0f6d8ff3b428 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.168975 May 26 16:49:08.203072 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 7/15] 10.222.0.112 () {64 vars in 1340 bytes} [Thu May 26 16:49:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:10.556230 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-e456ef62-7341-4550-a85a-317af4e3922b admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:10.557231 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-e456ef62-7341-4550-a85a-317af4e3922b admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001431 May 26 16:49:10.558800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 9/16] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:49:10 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:10.623245 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-22ca5ee9-8853-4d5c-80e6-029a6dd3a09c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "id": "d4", "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:10.715438 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-22ca5ee9-8853-4d5c-80e6-029a6dd3a09c admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.150472 May 26 16:49:10.720382 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 8/17] 10.222.0.112 () {64 vars in 1287 bytes} [Thu May 26 16:49:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:49:10.728237 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-21b16dbb-9b14-4f45-bdb2-625399951afa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:10.832903 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-21b16dbb-9b14-4f45-bdb2-625399951afa admin admin] 10.222.0.112 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108562 May 26 16:49:10.833436 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 10/18] 10.222.0.112 () {64 vars in 1340 bytes} [Thu May 26 16:49:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:13.159470 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-22ca5ee9-8853-4d5c-80e6-029a6dd3a09c admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:13.160092 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-22ca5ee9-8853-4d5c-80e6-029a6dd3a09c admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001443 May 26 16:49:13.160712 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 9/19] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:49:13 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:13.229505 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-7d5e76b6-9c03-4125-b7dd-234c7398ab2e admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:13.253833 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-7d5e76b6-9c03-4125-b7dd-234c7398ab2e admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.087096 May 26 16:49:13.254383 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 11/20] 10.222.0.112 () {60 vars in 1296 bytes} [Thu May 26 16:49:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:49:15.833302 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-22ca5ee9-8853-4d5c-80e6-029a6dd3a09c admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:15.834352 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-22ca5ee9-8853-4d5c-80e6-029a6dd3a09c admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001458 May 26 16:49:15.834750 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 10/21] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:49:15 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:15.902904 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-0a1dad4f-3cde-4c22-a4f0-09edd5209a32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "rxtx_factor": 1.0}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:16.026836 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-0a1dad4f-3cde-4c22-a4f0-09edd5209a32 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.182917 May 26 16:49:16.027340 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 12/22] 10.222.0.112 () {64 vars in 1287 bytes} [Thu May 26 16:49:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:49:16.041335 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-1335ef17-848d-40ce-a7d5-53f6db4d3b07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:16.119998 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-1335ef17-848d-40ce-a7d5-53f6db4d3b07 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081667 May 26 16:49:16.121266 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 11/23] 10.222.0.112 () {64 vars in 1337 bytes} [Thu May 26 16:49:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:19.158357 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-0a1dad4f-3cde-4c22-a4f0-09edd5209a32 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:19.159829 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-0a1dad4f-3cde-4c22-a4f0-09edd5209a32 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002422 May 26 16:49:19.160352 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 13/24] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:49:19 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:19.230288 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-ee76a406-60fe-4177-8c3f-bb88748f8d33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:19.344620 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-ee76a406-60fe-4177-8c3f-bb88748f8d33 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.175621 May 26 16:49:19.345097 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 12/25] 10.222.0.112 () {64 vars in 1287 bytes} [Thu May 26 16:49:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 16:49:19.358144 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-8d439cc8-6fa6-4570-89ad-6754bf3efcb3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:19.496297 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-8d439cc8-6fa6-4570-89ad-6754bf3efcb3 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142526 May 26 16:49:19.497034 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 14/26] 10.222.0.112 () {64 vars in 1337 bytes} [Thu May 26 16:49:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:21.894043 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-ee76a406-60fe-4177-8c3f-bb88748f8d33 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:21.895205 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-ee76a406-60fe-4177-8c3f-bb88748f8d33 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001668 May 26 16:49:21.895625 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 13/27] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:49:21 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:21.956466 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-b68d97b8-38fa-4057-b0c8-44fa4ac0c334 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:22.043398 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-b68d97b8-38fa-4057-b0c8-44fa4ac0c334 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.140930 May 26 16:49:22.043946 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 15/28] 10.222.0.112 () {64 vars in 1287 bytes} [Thu May 26 16:49:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:49:22.056141 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-fe61d058-abe6-4a55-96fd-b8c476584447 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:22.155319 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-fe61d058-abe6-4a55-96fd-b8c476584447 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103119 May 26 16:49:22.155914 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 14/29] 10.222.0.112 () {64 vars in 1337 bytes} [Thu May 26 16:49:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:24.495734 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-b68d97b8-38fa-4057-b0c8-44fa4ac0c334 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:24.497348 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-b68d97b8-38fa-4057-b0c8-44fa4ac0c334 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.003338 May 26 16:49:24.497744 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 16/30] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:49:24 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:24.566549 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-ed0ecec7-56b6-416c-85ae-ab6f443e7016 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "disk": 80, "name": "m1.large"}} {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:24.654706 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-ed0ecec7-56b6-416c-85ae-ab6f443e7016 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.150924 May 26 16:49:24.662847 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 15/31] 10.222.0.112 () {64 vars in 1287 bytes} [Thu May 26 16:49:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:49:24.668759 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-ffd109b0-d113-40b0-af41-fdb2a138f7dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:24.800154 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-ffd109b0-d113-40b0-af41-fdb2a138f7dd admin admin] 10.222.0.112 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135652 May 26 16:49:24.800700 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 17/32] 10.222.0.112 () {64 vars in 1337 bytes} [Thu May 26 16:49:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:27.223379 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-ed0ecec7-56b6-416c-85ae-ab6f443e7016 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:27.224393 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-ed0ecec7-56b6-416c-85ae-ab6f443e7016 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001489 May 26 16:49:27.225095 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 16/33] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:49:27 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:27.292652 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-a2c2cb79-279d-4998-945d-e6b7a580f43b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8, "id": "5", "disk": 160, "os-flavor-access:is_public": true}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:27.386623 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-a2c2cb79-279d-4998-945d-e6b7a580f43b admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.155351 May 26 16:49:27.387476 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 18/34] 10.222.0.112 () {64 vars in 1287 bytes} [Thu May 26 16:49:27 2022] POST /compute/v2.1/flavors => generated 410 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:49:27.399586 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-45828c49-7636-46a8-af34-a4c58c9603db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:27.409384 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG dbcounter [-] [115582] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:27.505844 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-45828c49-7636-46a8-af34-a4c58c9603db admin admin] 10.222.0.112 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110120 May 26 16:49:27.507044 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 17/35] 10.222.0.112 () {64 vars in 1337 bytes} [Thu May 26 16:49:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:52.582672 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-a2c2cb79-279d-4998-945d-e6b7a580f43b admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:52.583696 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-a2c2cb79-279d-4998-945d-e6b7a580f43b admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001487 May 26 16:49:52.584260 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 19/36] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:49:52 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:52.655847 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-1d6d0cca-4aa1-4566-b307-8fb7f1749ddd admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:52.673766 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-1d6d0cca-4aa1-4566-b307-8fb7f1749ddd admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.083260 May 26 16:49:52.674305 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 18/37] 10.222.0.112 () {60 vars in 1296 bytes} [Thu May 26 16:49:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:49:53.694923 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-a2c2cb79-279d-4998-945d-e6b7a580f43b admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:53.695926 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-a2c2cb79-279d-4998-945d-e6b7a580f43b admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002069 May 26 16:49:53.696315 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 20/38] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:49:53 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:53.895965 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-32cd2c6e-23da-4ae3-9637-bc0946c13b1f admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:53.901611 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.wsgi [None req-32cd2c6e-23da-4ae3-9637-bc0946c13b1f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-32cd2c6e-23da-4ae3-9637-bc0946c13b1f admin admin] Request method failure captured: May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Accept: application/json May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Accept-Encoding: gzip, deflate May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Connection: keep-alive May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Content-Length: 0 May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Host: 10.222.0.112 May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Openstack-Api-Version: compute 2.90 May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Openstack-System-Scope: None May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: User-Agent: python-novaclient May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Auth-Token: gAAAAABij6-x8XgKvbS04_mH389Gu4rYn-8d7hI5OhQD_y50Chf8UKVp1zlY5oc2F8BMHyNHooZVInDjxtQzl6mJwRCKHLbcEJt66AbJU2drcgozm2LAZpOnn1dSMM1ZLxFaZxmw7egEyhnGkrK0LbYCZP7grHLLF0gBzQelYrfAAxRECDD1O-s May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Domain-Id: None May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Domain-Name: None May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Identity-Status: Confirmed May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Is-Admin-Project: True May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Project-Domain-Id: default May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Project-Domain-Name: Default May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Project-Id: 9dda95f8437548158ad5e83593c71483 May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Project-Name: admin May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Role: admin,reader,member May 26 16:49:53.904937 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Roles: admin,reader,member May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/9dda95f8437548158ad5e83593c71483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/9dda95f8437548158ad5e83593c71483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/9dda95f8437548158ad5e83593c71483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_9dda95f8437548158ad5e83593c71483"}]}] May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Tenant: admin May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Tenant-Id: 9dda95f8437548158ad5e83593c71483 May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Tenant-Name: admin May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User: admin May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User-Domain-Id: default May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User-Domain-Name: Default May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User-Id: d22ba20f962d4757847ba75ce1eef95a May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User-Name: admin May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: method: > May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: exception: Flavor 42 could not be found. May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: action_args: {'id': '42'} May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:49:53.906636 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:53.907609 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:53.908714 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-32cd2c6e-23da-4ae3-9637-bc0946c13b1f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:49:53.909813 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-32cd2c6e-23da-4ae3-9637-bc0946c13b1f admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066104 May 26 16:49:53.909813 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 19/39] 10.222.0.112 () {60 vars in 1195 bytes} [Thu May 26 16:49:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:49:53.916734 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-bc35298c-6b83-46c3-95fb-058e6d255e5d admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:53.919684 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:53.939239 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-bc35298c-6b83-46c3-95fb-058e6d255e5d admin admin] 10.222.0.112 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.026722 May 26 16:49:53.939808 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 21/40] 10.222.0.112 () {60 vars in 1215 bytes} [Thu May 26 16:49:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:49:53.949672 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-2e37c510-e4ba-4ae8-a311-e0fa34504289 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:53.970756 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-2e37c510-e4ba-4ae8-a311-e0fa34504289 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.024647 May 26 16:49:53.971304 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 20/41] 10.222.0.112 () {60 vars in 1215 bytes} [Thu May 26 16:49:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:49:53.981418 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-7fd037dc-ef44-4289-a9aa-0ab71fa898ec admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:53.987481 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.wsgi [None req-7fd037dc-ef44-4289-a9aa-0ab71fa898ec admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-7fd037dc-ef44-4289-a9aa-0ab71fa898ec admin admin] Request method failure captured: May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Accept: application/json May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Accept-Encoding: gzip, deflate May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Connection: keep-alive May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Content-Length: 0 May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Host: 10.222.0.112 May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Openstack-Api-Version: compute 2.90 May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Openstack-System-Scope: None May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: User-Agent: python-novaclient May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Auth-Token: gAAAAABij6-x8XgKvbS04_mH389Gu4rYn-8d7hI5OhQD_y50Chf8UKVp1zlY5oc2F8BMHyNHooZVInDjxtQzl6mJwRCKHLbcEJt66AbJU2drcgozm2LAZpOnn1dSMM1ZLxFaZxmw7egEyhnGkrK0LbYCZP7grHLLF0gBzQelYrfAAxRECDD1O-s May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Domain-Id: None May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Domain-Name: None May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Identity-Status: Confirmed May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Is-Admin-Project: True May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Project-Domain-Id: default May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Project-Domain-Name: Default May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Project-Id: 9dda95f8437548158ad5e83593c71483 May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Project-Name: admin May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Role: admin,reader,member May 26 16:49:53.990739 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Roles: admin,reader,member May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/9dda95f8437548158ad5e83593c71483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/9dda95f8437548158ad5e83593c71483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/9dda95f8437548158ad5e83593c71483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_9dda95f8437548158ad5e83593c71483"}]}] May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Tenant: admin May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Tenant-Id: 9dda95f8437548158ad5e83593c71483 May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Tenant-Name: admin May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User: admin May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User-Domain-Id: default May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User-Domain-Name: Default May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User-Id: d22ba20f962d4757847ba75ce1eef95a May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User-Name: admin May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: method: > May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: exception: Flavor 42 could not be found. May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: action_args: {'id': '42'} May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:49:53.993054 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:53.993875 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:53.995646 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-7fd037dc-ef44-4289-a9aa-0ab71fa898ec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:49:53.996873 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-7fd037dc-ef44-4289-a9aa-0ab71fa898ec admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015140 May 26 16:49:53.996873 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 22/42] 10.222.0.112 () {60 vars in 1195 bytes} [Thu May 26 16:49:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:49:54.877071 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-2e37c510-e4ba-4ae8-a311-e0fa34504289 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:54.878071 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-2e37c510-e4ba-4ae8-a311-e0fa34504289 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001425 May 26 16:49:54.878498 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 21/43] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:49:54 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:55.097529 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-199cb87f-e401-4f16-b67f-2dc2650cb63e admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:55.103303 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.wsgi [None req-199cb87f-e401-4f16-b67f-2dc2650cb63e admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-199cb87f-e401-4f16-b67f-2dc2650cb63e admin admin] Request method failure captured: May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Accept: application/json May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Accept-Encoding: gzip, deflate May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Connection: keep-alive May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Content-Length: 0 May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Host: 10.222.0.112 May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Openstack-Api-Version: compute 2.90 May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Openstack-System-Scope: None May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: User-Agent: python-novaclient May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Auth-Token: gAAAAABij6-yWPEu0qwYNGQm2jeXQ2p1DCqaDcnEPwldpgv1z_rcExq1tjKyudacUKs9Vog55Rdqvad7jGkOs0Xq4EVfMtkDBETda1E4e4sl2Hrnjs9r1mPoNDgiOzmxNECfAPdXbSHea3zoGmk6JN0MhRh4Ih7r0c6g8A8QZ8v91X_vtPvPlHI May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Domain-Id: None May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Domain-Name: None May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Identity-Status: Confirmed May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Is-Admin-Project: True May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Project-Domain-Id: default May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Project-Domain-Name: Default May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Project-Id: 9dda95f8437548158ad5e83593c71483 May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Project-Name: admin May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Role: admin,reader,member May 26 16:49:55.104800 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Roles: admin,reader,member May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/9dda95f8437548158ad5e83593c71483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/9dda95f8437548158ad5e83593c71483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/9dda95f8437548158ad5e83593c71483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_9dda95f8437548158ad5e83593c71483"}]}] May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Tenant: admin May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Tenant-Id: 9dda95f8437548158ad5e83593c71483 May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Tenant-Name: admin May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User: admin May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User-Domain-Id: default May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User-Domain-Name: Default May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User-Id: d22ba20f962d4757847ba75ce1eef95a May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User-Name: admin May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: method: > May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: exception: Flavor 84 could not be found. May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: action_args: {'id': '84'} May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:49:55.106401 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:55.107350 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:55.108487 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-199cb87f-e401-4f16-b67f-2dc2650cb63e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:49:55.109702 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-199cb87f-e401-4f16-b67f-2dc2650cb63e admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067218 May 26 16:49:55.109702 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 23/44] 10.222.0.112 () {60 vars in 1195 bytes} [Thu May 26 16:49:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:49:55.117789 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-bc889861-6810-46a0-8969-5c3646a35eed admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:55.134463 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-bc889861-6810-46a0-8969-5c3646a35eed admin admin] 10.222.0.112 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.021305 May 26 16:49:55.135013 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 22/45] 10.222.0.112 () {60 vars in 1215 bytes} [Thu May 26 16:49:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:49:55.144630 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-d1664684-38aa-4d0e-a796-311327cb8462 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:55.159100 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-d1664684-38aa-4d0e-a796-311327cb8462 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017989 May 26 16:49:55.159637 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 24/46] 10.222.0.112 () {60 vars in 1215 bytes} [Thu May 26 16:49:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:49:55.169123 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-b31221b1-fdb4-426e-94a3-72f535efa653 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:55.174849 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.wsgi [None req-b31221b1-fdb4-426e-94a3-72f535efa653 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-b31221b1-fdb4-426e-94a3-72f535efa653 admin admin] Request method failure captured: May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Accept: application/json May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Accept-Encoding: gzip, deflate May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Connection: keep-alive May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Content-Length: 0 May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Host: 10.222.0.112 May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Openstack-Api-Version: compute 2.90 May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Openstack-System-Scope: None May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: User-Agent: python-novaclient May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Auth-Token: gAAAAABij6-yWPEu0qwYNGQm2jeXQ2p1DCqaDcnEPwldpgv1z_rcExq1tjKyudacUKs9Vog55Rdqvad7jGkOs0Xq4EVfMtkDBETda1E4e4sl2Hrnjs9r1mPoNDgiOzmxNECfAPdXbSHea3zoGmk6JN0MhRh4Ih7r0c6g8A8QZ8v91X_vtPvPlHI May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Domain-Id: None May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Domain-Name: None May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Identity-Status: Confirmed May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Is-Admin-Project: True May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Project-Domain-Id: default May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Project-Domain-Name: Default May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Project-Id: 9dda95f8437548158ad5e83593c71483 May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Project-Name: admin May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Role: admin,reader,member May 26 16:49:55.176670 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Roles: admin,reader,member May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/9dda95f8437548158ad5e83593c71483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/9dda95f8437548158ad5e83593c71483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/9dda95f8437548158ad5e83593c71483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_9dda95f8437548158ad5e83593c71483"}]}] May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Tenant: admin May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Tenant-Id: 9dda95f8437548158ad5e83593c71483 May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Tenant-Name: admin May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User: admin May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User-Domain-Id: default May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User-Domain-Name: Default May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User-Id: d22ba20f962d4757847ba75ce1eef95a May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User-Name: admin May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: method: > May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: exception: Flavor 84 could not be found. May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: action_args: {'id': '84'} May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:49:55.178293 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:55.180446 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:55.181698 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-b31221b1-fdb4-426e-94a3-72f535efa653 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:49:55.183086 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-b31221b1-fdb4-426e-94a3-72f535efa653 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012511 May 26 16:49:55.183086 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 23/47] 10.222.0.112 () {60 vars in 1195 bytes} [Thu May 26 16:49:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:49:56.059634 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-d1664684-38aa-4d0e-a796-311327cb8462 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:56.060626 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-d1664684-38aa-4d0e-a796-311327cb8462 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001455 May 26 16:49:56.061015 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 25/48] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:49:56 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:56.257871 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-54c2c9a9-4195-4533-8d21-57d16f9c22e7 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:56.263677 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.wsgi [None req-54c2c9a9-4195-4533-8d21-57d16f9c22e7 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-54c2c9a9-4195-4533-8d21-57d16f9c22e7 admin admin] Request method failure captured: May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Accept: application/json May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Accept-Encoding: gzip, deflate May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Connection: keep-alive May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Content-Length: 0 May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Host: 10.222.0.112 May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Openstack-Api-Version: compute 2.90 May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Openstack-System-Scope: None May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: User-Agent: python-novaclient May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Auth-Token: gAAAAABij6-0AJDsSzwf4Mms_yy1u_0zetmDTQsTn_5wzm4Gs7H_0_JuInhmQHoT4IEYhzlvEThb8cMRwR6HOaun_PkL6KL3v3GO2qF-vlMG8o_KXoc9B-Ay7aKKgUb8w_g3xXWzsvL5Gvz4tEsjco6N8WPwAGwXQGzeKT3smUqLiil25TORagY May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Domain-Id: None May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Domain-Name: None May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Identity-Status: Confirmed May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Is-Admin-Project: True May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Project-Domain-Id: default May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Project-Domain-Name: Default May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Project-Id: 9dda95f8437548158ad5e83593c71483 May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Project-Name: admin May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Role: admin,reader,member May 26 16:49:56.265170 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Roles: admin,reader,member May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/9dda95f8437548158ad5e83593c71483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/9dda95f8437548158ad5e83593c71483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/9dda95f8437548158ad5e83593c71483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_9dda95f8437548158ad5e83593c71483"}]}] May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Tenant: admin May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Tenant-Id: 9dda95f8437548158ad5e83593c71483 May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-Tenant-Name: admin May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User: admin May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User-Domain-Id: default May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User-Domain-Name: Default May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User-Id: d22ba20f962d4757847ba75ce1eef95a May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: X-User-Name: admin May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: method: > May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: exception: Flavor 451 could not be found. May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: action_args: {'id': '451'} May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:49:56.266772 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:56.267656 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: ERROR nova.api.openstack.wsgi May 26 16:49:56.268748 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-54c2c9a9-4195-4533-8d21-57d16f9c22e7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:49:56.269799 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-54c2c9a9-4195-4533-8d21-57d16f9c22e7 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066640 May 26 16:49:56.269799 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 24/49] 10.222.0.112 () {60 vars in 1198 bytes} [Thu May 26 16:49:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:49:56.277027 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-19bf6d52-7b48-4b9e-9be1-6463eb9a2a74 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:56.292815 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-19bf6d52-7b48-4b9e-9be1-6463eb9a2a74 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019270 May 26 16:49:56.293344 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 26/50] 10.222.0.112 () {60 vars in 1215 bytes} [Thu May 26 16:49:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:49:56.303196 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:56.316979 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017652 May 26 16:49:56.317516 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 25/51] 10.222.0.112 () {60 vars in 1215 bytes} [Thu May 26 16:49:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:49:56.327451 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-b5d6d34c-4b69-4701-b7b5-ae1358c66655 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:56.332767 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.wsgi [None req-b5d6d34c-4b69-4701-b7b5-ae1358c66655 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-b5d6d34c-4b69-4701-b7b5-ae1358c66655 admin admin] Request method failure captured: May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Accept: application/json May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Accept-Encoding: gzip, deflate May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Connection: keep-alive May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Content-Length: 0 May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Host: 10.222.0.112 May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Openstack-Api-Version: compute 2.90 May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Openstack-System-Scope: None May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: User-Agent: python-novaclient May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Auth-Token: gAAAAABij6-0AJDsSzwf4Mms_yy1u_0zetmDTQsTn_5wzm4Gs7H_0_JuInhmQHoT4IEYhzlvEThb8cMRwR6HOaun_PkL6KL3v3GO2qF-vlMG8o_KXoc9B-Ay7aKKgUb8w_g3xXWzsvL5Gvz4tEsjco6N8WPwAGwXQGzeKT3smUqLiil25TORagY May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Domain-Id: None May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Domain-Name: None May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Identity-Status: Confirmed May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Is-Admin-Project: True May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Project-Domain-Id: default May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Project-Domain-Name: Default May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Project-Id: 9dda95f8437548158ad5e83593c71483 May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Project-Name: admin May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Role: admin,reader,member May 26 16:49:56.334241 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Roles: admin,reader,member May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/9dda95f8437548158ad5e83593c71483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/9dda95f8437548158ad5e83593c71483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/9dda95f8437548158ad5e83593c71483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_9dda95f8437548158ad5e83593c71483"}]}] May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Tenant: admin May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Tenant-Id: 9dda95f8437548158ad5e83593c71483 May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-Tenant-Name: admin May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User: admin May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User-Domain-Id: default May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User-Domain-Name: Default May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User-Id: d22ba20f962d4757847ba75ce1eef95a May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: X-User-Name: admin May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: method: > May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: exception: Flavor 451 could not be found. May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: action_args: {'id': '451'} May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:49:56.336613 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:56.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: ERROR nova.api.openstack.wsgi May 26 16:49:56.338571 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-b5d6d34c-4b69-4701-b7b5-ae1358c66655 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:49:56.339600 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-b5d6d34c-4b69-4701-b7b5-ae1358c66655 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012711 May 26 16:49:56.339600 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 27/52] 10.222.0.112 () {60 vars in 1198 bytes} [Thu May 26 16:49:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:49:57.237470 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:57.238517 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001466 May 26 16:49:57.238910 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 26/53] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:49:57 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:57.433204 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-446c1ebc-9ad1-42ab-89f3-0939df353fa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:57.516709 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-446c1ebc-9ad1-42ab-89f3-0939df353fa7 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.138508 May 26 16:49:57.517162 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 28/54] 10.222.0.112 () {64 vars in 1240 bytes} [Thu May 26 16:49:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:49:58.424438 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:58.425445 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001432 May 26 16:49:58.425842 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 27/55] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:49:58 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:58.622581 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-c73c19f5-3b2d-4095-ac93-673c3fe2fda1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:58.726442 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-c73c19f5-3b2d-4095-ac93-673c3fe2fda1 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.157749 May 26 16:49:58.726990 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 29/56] 10.222.0.112 () {64 vars in 1240 bytes} [Thu May 26 16:49:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:49:59.606931 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:59.608025 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001572 May 26 16:49:59.609099 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 28/57] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:49:59 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:59.810999 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-8ae43f16-531c-4d09-8095-97cd69bece84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:59.903677 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-8ae43f16-531c-4d09-8095-97cd69bece84 admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.156400 May 26 16:49:59.904220 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 30/58] 10.222.0.112 () {64 vars in 1240 bytes} [Thu May 26 16:49:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:50:00.788691 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:00.789393 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001739 May 26 16:50:00.789800 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 29/59] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:50:00 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:50:00.996827 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-9531b41f-a1db-4859-afcc-403f1d4f91ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:50:01.082692 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-9531b41f-a1db-4859-afcc-403f1d4f91ff admin admin] 10.222.0.112 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.140445 May 26 16:50:01.083235 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 31/60] 10.222.0.112 () {64 vars in 1240 bytes} [Thu May 26 16:50:00 2022] POST /compute/v2.1/flavors => generated 411 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:50:01.979176 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:01.980206 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001450 May 26 16:50:01.980627 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 30/61] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:50:01 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:50:02.172242 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-9d6a5c21-42af-462c-a79f-23e02e3e6d18 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:02.192760 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-9d6a5c21-42af-462c-a79f-23e02e3e6d18 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.075158 May 26 16:50:02.193204 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 32/62] 10.222.0.112 () {60 vars in 1207 bytes} [Thu May 26 16:50:02 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:06.138275 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:06.139295 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-c08e16b6-0452-4f02-bc34-76d34341acf1 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001452 May 26 16:51:06.139679 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 31/63] 10.222.0.112 () {54 vars in 935 bytes} [Thu May 26 16:51:06 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:51:06.147624 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:06.199775 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-d4fc4c95-f601-4741-9be0-07875e5ad924 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:06.220039 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-d4fc4c95-f601-4741-9be0-07875e5ad924 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.073771 May 26 16:51:06.220570 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 33/64] 10.222.0.112 () {60 vars in 1296 bytes} [Thu May 26 16:51:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:06.241404 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG dbcounter [-] [115582] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=115582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:06.245186 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-d0b1444f-7991-45a7-99ad-6b4c42b125da admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:06.254450 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-d0b1444f-7991-45a7-99ad-6b4c42b125da admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013548 May 26 16:51:06.254450 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 32/65] 10.222.0.112 () {60 vars in 1287 bytes} [Thu May 26 16:51:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:06.265542 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-31fb69a6-10b7-4328-b08e-8f032e891195 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:06.273381 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-31fb69a6-10b7-4328-b08e-8f032e891195 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011440 May 26 16:51:06.273901 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 34/66] 10.222.0.112 () {60 vars in 1290 bytes} [Thu May 26 16:51:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:06.285744 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:06.293420 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011721 May 26 16:51:06.295494 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 33/67] 10.222.0.112 () {60 vars in 1290 bytes} [Thu May 26 16:51:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:06.307616 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-1f10c52c-99ba-496a-92bc-2b90b6f2c409 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:06.316328 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-1f10c52c-99ba-496a-92bc-2b90b6f2c409 admin admin] 10.222.0.112 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012300 May 26 16:51:06.316855 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 35/68] 10.222.0.112 () {60 vars in 1287 bytes} [Thu May 26 16:51:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:22.236150 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:22.237199 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001488 May 26 16:55:22.237593 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 34/69] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:55:22 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:22.399831 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_api:SELECT=6 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:22.515224 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-86f1d7a0-a632-422d-830d-5a3d6df12d53 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:22.516391 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:55:22.516391 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: warnings.warn(msg) May 26 16:55:22.517588 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-86f1d7a0-a632-422d-830d-5a3d6df12d53 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:22.518031 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-86f1d7a0-a632-422d-830d-5a3d6df12d53 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:22.518883 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-86f1d7a0-a632-422d-830d-5a3d6df12d53 admin admin] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:22.519310 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-86f1d7a0-a632-422d-830d-5a3d6df12d53 admin admin] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:22.553075 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-86f1d7a0-a632-422d-830d-5a3d6df12d53 admin admin] 10.222.0.112 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154812 May 26 16:55:22.553634 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 36/70] 10.222.0.112 () {60 vars in 1198 bytes} [Thu May 26 16:55:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:55:23.432889 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:23.433935 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001456 May 26 16:55:23.434347 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 35/71] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:55:23 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:23.626066 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-3e130158-bebc-4f40-af1f-23ac0b87870e admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:23.627258 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:55:23.627258 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: warnings.warn(msg) May 26 16:55:23.628441 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-3e130158-bebc-4f40-af1f-23ac0b87870e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:23.628880 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-3e130158-bebc-4f40-af1f-23ac0b87870e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:23.629665 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-3e130158-bebc-4f40-af1f-23ac0b87870e admin admin] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:23.630090 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-3e130158-bebc-4f40-af1f-23ac0b87870e admin admin] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:23.650057 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-3e130158-bebc-4f40-af1f-23ac0b87870e admin admin] 10.222.0.112 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076273 May 26 16:55:23.650623 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 37/72] 10.222.0.112 () {60 vars in 1198 bytes} [Thu May 26 16:55:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:55:34.946388 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:34.947668 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001739 May 26 16:55:34.948057 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 36/73] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:55:34 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:35.098791 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_cell0:SELECT=4 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:35.099518 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_cell1:SELECT=4 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:35.100134 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_api:SELECT=8 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:35.148749 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-a85b023d-45f1-43b8-bde7-3bbec3c6d206 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:35.148749 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:55:35.148749 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: warnings.warn(msg) May 26 16:55:35.149773 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-a85b023d-45f1-43b8-bde7-3bbec3c6d206 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:35.150217 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-a85b023d-45f1-43b8-bde7-3bbec3c6d206 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:35.151022 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-a85b023d-45f1-43b8-bde7-3bbec3c6d206 admin admin] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:35.151451 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-a85b023d-45f1-43b8-bde7-3bbec3c6d206 admin admin] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:35.172591 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-a85b023d-45f1-43b8-bde7-3bbec3c6d206 admin admin] 10.222.0.112 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078268 May 26 16:55:35.173066 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 38/74] 10.222.0.112 () {60 vars in 1198 bytes} [Thu May 26 16:55:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:55:36.060925 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:36.062171 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001648 May 26 16:55:36.062595 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 37/75] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:55:36 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:36.252495 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-4b74dec8-367a-4207-934c-4185e39f7b63 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:36.253677 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:55:36.253677 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: warnings.warn(msg) May 26 16:55:36.254887 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-4b74dec8-367a-4207-934c-4185e39f7b63 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:36.255320 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-4b74dec8-367a-4207-934c-4185e39f7b63 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:36.256104 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-4b74dec8-367a-4207-934c-4185e39f7b63 admin admin] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:36.256525 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-4b74dec8-367a-4207-934c-4185e39f7b63 admin admin] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:36.276216 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-4b74dec8-367a-4207-934c-4185e39f7b63 admin admin] 10.222.0.112 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076614 May 26 16:55:36.276700 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 39/76] 10.222.0.112 () {60 vars in 1198 bytes} [Thu May 26 16:55:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:55:47.604899 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:47.605911 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001462 May 26 16:55:47.606311 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 38/77] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:55:47 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:47.749817 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_cell0:SELECT=4 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:47.750756 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_cell1:SELECT=4 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:47.751390 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG dbcounter [-] [115583] Writing DB stats nova_api:SELECT=8 {{(pid=115583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:47.801202 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-38c4924d-c37d-4ecc-81d9-b25b6ab577d9 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:47.801694 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:55:47.801694 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: warnings.warn(msg) May 26 16:55:47.802965 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-38c4924d-c37d-4ecc-81d9-b25b6ab577d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:47.803406 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-38c4924d-c37d-4ecc-81d9-b25b6ab577d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:47.804198 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-38c4924d-c37d-4ecc-81d9-b25b6ab577d9 admin admin] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:47.804634 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-38c4924d-c37d-4ecc-81d9-b25b6ab577d9 admin admin] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:47.831278 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-38c4924d-c37d-4ecc-81d9-b25b6ab577d9 admin admin] 10.222.0.112 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086413 May 26 16:55:47.831766 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 40/78] 10.222.0.112 () {60 vars in 1198 bytes} [Thu May 26 16:55:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:55:48.704671 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: DEBUG nova.api.openstack.wsgi [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] Calling method '>' {{(pid=115582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:48.705689 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: INFO nova.api.openstack.requestlog [None req-d2461d20-7eca-4284-9005-bc777460b815 admin admin] 10.222.0.112 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001482 May 26 16:55:48.706094 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: [pid: 115582|app: 0|req: 39/79] 10.222.0.112 () {56 vars in 1079 bytes} [Thu May 26 16:55:48 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:48.902412 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG nova.api.openstack.wsgi [None req-826a3bc8-c505-4bc4-b972-79fde0620796 admin admin] Calling method '>' {{(pid=115583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:48.903567 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:55:48.903567 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: warnings.warn(msg) May 26 16:55:48.904736 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-826a3bc8-c505-4bc4-b972-79fde0620796 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:48.905171 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-826a3bc8-c505-4bc4-b972-79fde0620796 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:48.906092 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-826a3bc8-c505-4bc4-b972-79fde0620796 admin admin] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:48.906545 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: DEBUG oslo_concurrency.lockutils [None req-826a3bc8-c505-4bc4-b972-79fde0620796 admin admin] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:48.928284 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: INFO nova.api.openstack.requestlog [None req-826a3bc8-c505-4bc4-b972-79fde0620796 admin admin] 10.222.0.112 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078496 May 26 16:55:48.928820 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: [pid: 115583|app: 0|req: 41/80] 10.222.0.112 () {60 vars in 1198 bytes} [Thu May 26 16:55:48 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:56.742443 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: Thu May 26 16:56:56 2022 - graceful shutdown triggered... May 26 16:56:56.741876 dv-cinder-836072-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 16:56:56.744587 dv-cinder-836072-5-iscsi devstack@n-api.service[115582]: Gracefully killing worker 1 (pid: 115582)... May 26 16:56:56.745451 dv-cinder-836072-5-iscsi devstack@n-api.service[115583]: Gracefully killing worker 2 (pid: 115583)... May 26 16:56:57.742482 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: worker 1 buried after 1 seconds May 26 16:56:57.742482 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: worker 2 buried after 1 seconds May 26 16:56:57.742482 dv-cinder-836072-5-iscsi devstack@n-api.service[115581]: goodbye to uWSGI. May 26 16:56:57.744276 dv-cinder-836072-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 16:56:57.745042 dv-cinder-836072-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 16:56:57.748897 dv-cinder-836072-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 16:56:57.758873 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 16:56:57.774658 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 16:56:57 2022] *** May 26 16:56:57.774658 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 16:56:57.774658 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 16:56:57.774658 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: nodename: dv-cinder-836072-5-iscsi May 26 16:56:57.774658 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: machine: x86_64 May 26 16:56:57.774658 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: clock source: unix May 26 16:56:57.774658 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: pcre jit disabled May 26 16:56:57.774658 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: detected number of CPU cores: 4 May 26 16:56:57.774658 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: current working directory: / May 26 16:56:57.774658 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: detected binary path: /usr/bin/uwsgi-core May 26 16:56:57.774658 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: your processes number limit is 47680 May 26 16:56:57.776038 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: your memory page size is 4096 bytes May 26 16:56:57.776038 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: detected max file descriptor number: 2048 May 26 16:56:57.776038 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: lock engine: pthread robust mutexes May 26 16:56:57.776038 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: thunder lock: enabled May 26 16:56:57.776038 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 16:56:57.776038 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 16:56:57.851495 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: Python main interpreter initialized at 0x5649d57519c0 May 26 16:56:57.851495 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: python threads support enabled May 26 16:56:57.851495 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: your server socket listen backlog is limited to 100 connections May 26 16:56:57.851495 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: your mercy for graceful operations on workers is 90 seconds May 26 16:56:57.852105 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: mapped 403077 bytes (393 KB) for 2 cores May 26 16:56:57.852269 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: *** Operational MODE: preforking *** May 26 16:56:57.852579 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: *** uWSGI is running in multiple interpreter mode *** May 26 16:56:57.852579 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: spawned uWSGI master process (pid: 130510) May 26 16:56:57.852854 dv-cinder-836072-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 16:56:57.854155 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: spawned uWSGI worker 1 (pid: 130525, cores: 1) May 26 16:56:57.854419 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: spawned uWSGI worker 2 (pid: 130526, cores: 1) May 26 16:56:57.854548 dv-cinder-836072-5-iscsi devstack@n-api.service[130510]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 16:56:59.082278 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 16:56:59.144469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 16:56:59.882029 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:56:59.882029 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: from cryptography.utils import int_from_bytes May 26 16:56:59.882453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:56:59.882453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: from cryptography.utils import int_from_bytes May 26 16:56:59.987176 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:56:59.987176 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: from cryptography.utils import int_from_bytes May 26 16:56:59.987604 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:56:59.987604 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: from cryptography.utils import int_from_bytes May 26 16:57:02.380696 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:57:02.381327 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:57:02.381657 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:57:02.381876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:57:02.382153 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:57:02.382572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.382917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.383231 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.383681 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.383908 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.384213 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.384544 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.384873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.385209 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.385480 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.385807 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.386138 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836072-5-iscsi {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.386494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.386810 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.387130 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.387455 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.387767 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.388096 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.388414 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.388922 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.390550 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.390880 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.391274 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.391823 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.392201 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.392658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.392991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.393332 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.393661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.393984 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.394445 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836072-5-iscsi {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.394779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.395106 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.395433 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.395874 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.396203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.396503 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.396837 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.397180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.397487 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.397821 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.398189 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.398498 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.398829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.399140 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.399465 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.399787 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.400121 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.400432 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.400748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.401005 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.401326 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.401717 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.401971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.402302 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.402587 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.407585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.408075 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.408075 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.408495 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.112 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.408758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.112 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.409078 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.409435 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.409765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.410093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.410459 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.410791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.411111 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.411429 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.411746 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.412074 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.412408 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.412722 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.412986 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.413296 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.413610 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.413941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.414247 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.414607 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.414923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.415233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.415547 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.415864 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.416177 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.416493 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.416805 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.417120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.417437 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.417750 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.418064 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.418432 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.418760 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.419076 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.419396 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.419710 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.420025 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.420353 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.420667 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.421010 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.421310 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.421623 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.421937 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.422264 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.423149 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.424109 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.424450 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.424762 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.425085 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.425405 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.425723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.426041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.426371 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.426692 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.427373 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.427373 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.427698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.427917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.428228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.428711 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.428888 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.429192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.429575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.429821 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.430154 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.430549 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.430896 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.431254 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.435916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.435916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.435916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.435916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.435916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.435916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.435916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.435916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.436512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.436512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.436512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.436512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.436512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.436512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.436512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.436512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.437042 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.437042 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.437450 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.437634 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.441027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.441027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.441027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.441027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.441027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.441027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.441963 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.441963 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.441963 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.442439 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.442439 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.442759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.443044 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.443370 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.443697 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.444020 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.444343 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.444667 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.445020 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.445345 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.445668 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.445992 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.446369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.446668 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.446990 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.447314 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.447632 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.447949 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.448265 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.448586 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.448900 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.449233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.449572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.449892 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.450240 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.450600 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.450923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.451245 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.451590 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.451885 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.452465 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.452788 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.453120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.453490 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.454530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.454530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.454890 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.455717 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.455897 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.456148 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.456476 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.456803 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.457221 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.457465 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.457773 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.458124 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.458471 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.458837 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.459169 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.459490 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.459823 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.460161 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.460490 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.460811 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.461131 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.461518 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.461837 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.462180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.462498 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.462813 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.463128 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.463458 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.463761 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.464078 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.464410 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.464730 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.465043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.465355 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.465667 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.466019 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.466348 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.466715 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.467063 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.467391 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.467722 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.468044 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.468371 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.468691 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.469012 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.469356 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.470251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.470621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.470953 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.471294 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.471617 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.471953 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.472272 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.472602 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.472918 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.473245 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.473596 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.473942 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.474268 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.474641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.474961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.476877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.476877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.476877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.476877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.476877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.476877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.477859 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.477859 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.477859 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.478361 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.478529 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.478771 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.479060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.479384 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.479720 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.480065 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.480379 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.480701 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.481129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.481451 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.481801 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.482086 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.482425 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.482743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.483061 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.483386 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.483706 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.484027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.484343 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.484680 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.485540 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.486572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.486957 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.487221 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.487559 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.487884 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.488218 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.488552 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.488879 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.489179 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.489511 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.489827 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.490143 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.490480 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.490796 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.491148 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.491467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.491793 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.492537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.492537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.492852 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.493049 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.493363 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.493681 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.494021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.494361 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.494673 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.494995 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.495314 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.495634 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.495955 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.496342 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.496605 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.496933 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.497249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.497560 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.497879 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.498206 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.498847 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.499203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.499531 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.499899 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.500270 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.500649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.502119 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.502572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.502937 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.503262 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.503586 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.503906 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.504225 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.504550 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.504870 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.505187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.505501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.505823 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.506141 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.506915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.506915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.507267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.507418 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.507734 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.508054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.508372 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.508711 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.509053 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.509346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.509662 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.509977 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.510354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.510666 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.511550 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.511550 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.511844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.511997 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.512296 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.512631 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.512949 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.513264 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.513578 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.513899 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.517360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.517360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.517360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.517360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.517360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.517360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.517360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.517360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.522219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.522219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.522219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.522219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.522219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.522219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.522219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.522219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.523966 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.524458 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.524458 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.524718 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.525007 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.525336 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.525653 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.525972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.526290 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.526633 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.526949 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.527266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.527581 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.528404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.528404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.528567 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.528836 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.529127 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.529447 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.529760 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.530129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.530422 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.530775 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.531091 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.531200 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:57:02.531589 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:57:02.531673 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.531756 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.532576 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:57:02.532777 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.533142 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:57:02.533494 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:57:02.533650 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.533897 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.534063 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.534218 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.534447 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.534628 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.534788 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.534962 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.535126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.535370 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.535521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.535710 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.535894 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.536059 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.536213 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.536393 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.536541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.536541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.536843 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.536843 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.537141 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.537295 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.537493 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.537644 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836072-5-iscsi {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.537806 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.537975 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.538129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.538296 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.538463 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.538621 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.538777 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.538932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.539095 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.539263 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.539427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.539601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.539788 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.539968 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.540130 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.540130 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.540434 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.540643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.540823 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.540998 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.541153 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.541313 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.541472 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.542633 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.542741 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.542830 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.542915 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.542999 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.543091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.543220 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.543350 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.543450 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.543538 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.543538 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.543538 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.543785 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836072-5-iscsi {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.543876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.543957 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.544312 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.544425 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.544571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.544656 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.544902 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.544992 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.545230 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.545336 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.545557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.545651 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.545879 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.545980 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.546206 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.546315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.546554 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.546744 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.546888 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.547002 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.547217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.547312 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.547687 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.547801 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.548200 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.548517 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.548691 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.548839 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.549022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.549159 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.549352 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.549488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.549685 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.549805 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.550018 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.550121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.550355 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.550467 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.550695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.550789 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.551023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.551117 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.551353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.551460 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.551681 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.551776 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.551944 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.552049 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.552232 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.552338 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.552527 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.552654 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.552851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.552948 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.553164 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.553266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.553479 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.553581 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.553791 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.553885 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.554104 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.554213 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.554576 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.554686 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.554774 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.554874 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.555050 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.555250 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.555352 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.555573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.555667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.555890 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.555985 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.556378 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.556517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.556607 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.556708 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.556926 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.557021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.557257 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.557357 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.112 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.557575 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.112 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.557676 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.557890 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.557985 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.558211 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.558310 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.558571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.567809 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.567935 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.568032 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.568159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.568240 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.568322 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.568405 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.568479 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.568550 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.568550 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.568693 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.568773 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.568855 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.568936 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.569009 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.569080 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.569157 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.569229 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.569390 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.569467 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.569599 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.569684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.569757 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.569836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.569941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.570037 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.570131 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.570217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.570217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.570408 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.570501 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.570501 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.570672 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.570765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.570851 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.570945 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.571032 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.571115 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.571207 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.571300 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.571392 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.571491 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.571584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.571677 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.571769 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.571862 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.571954 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.572053 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.572167 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.572278 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.572367 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.572454 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.573893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.574024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.574132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.574230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.574381 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.575521 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.575635 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.575714 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.575787 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.575873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.575954 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.576033 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.576112 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.576207 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.576295 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.576389 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.576476 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.576564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.576637 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.576728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.576814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.576909 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.577003 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.577089 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.577440 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.577529 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.577623 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.577710 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.577795 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.577880 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.577973 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.578066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.578166 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.578260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.578380 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.578477 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.578563 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.578656 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.578873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.579025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.579122 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.579219 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.579313 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.579401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.579497 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.579586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.579671 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.579764 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.579851 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.579951 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.580038 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.580132 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.580226 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.580319 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.580413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.580520 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.580616 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.580702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.580795 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.580890 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.580976 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.581071 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.581166 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.581260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.581353 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.581439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:57:02.581524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.581640 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.581725 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.581806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.581892 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.582128 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.582239 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.582346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.582346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.582523 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.582604 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.582683 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.582769 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.582769 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.582924 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.582997 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.583083 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.583083 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.583251 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.583345 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.583432 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.583432 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.583594 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.583681 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.583799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.583898 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.583985 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.584070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.584155 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.584250 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.584337 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.584424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.584504 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.584596 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.584683 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.584781 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.584870 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.584944 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.585031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.585119 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.585204 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.585297 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.585384 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.585469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.585571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.585644 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.585723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.585818 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.585906 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.586101 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.586210 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.586448 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.586609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.586783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.586888 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.587112 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.587216 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.587430 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.587536 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.587748 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.588012 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.588115 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.588353 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.588462 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.588681 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.588777 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.589007 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.589109 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.589328 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.589439 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.589647 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.589750 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.589965 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.590068 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.590286 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.590443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.590627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.590737 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.590947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.591041 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.591271 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.591377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.591597 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.591689 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.591922 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.592029 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.592240 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.592349 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.592564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.592664 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.592883 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.592974 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.593202 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.593305 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.593520 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.593614 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.593833 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.593927 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.594144 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.594241 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.595023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.595341 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.595570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.595677 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.595904 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.596000 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.596236 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.596351 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.596562 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.596695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.596894 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.597016 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.597221 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.597318 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.597541 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.597653 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.597858 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.597955 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.598174 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.598279 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.598513 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.598644 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.598832 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.598935 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.599153 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.599255 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.599466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.599572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.599796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.599905 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.600111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.600204 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.600425 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.600520 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.600755 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.600858 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.601069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.601164 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.601381 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.601484 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.601701 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.601909 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.602011 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.602233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.603655 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.603761 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.603850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.603944 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.603944 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.604107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.604107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.604107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.604434 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.604723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.604823 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.605059 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.605159 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.605397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.605500 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.605717 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.605818 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.606035 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.606141 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.606376 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.606477 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.619372 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.619466 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.619571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.619661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.619747 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.619841 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.619928 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.620023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.620111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.620197 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.620281 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.620374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.620461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.620561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.620649 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.620649 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.620827 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.620922 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.621016 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.621112 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.621207 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.621294 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.621422 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.621526 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.621526 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.621708 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.621802 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.621802 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.621966 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.621966 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.622136 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.622136 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.622302 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.622302 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.622528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.622615 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.622711 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.622807 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.622893 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.622978 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.623071 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.623158 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.623241 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.623322 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.623415 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.623502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.623576 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.623654 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.623750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.623843 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.623930 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.624014 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.624107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.624203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.624289 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.624368 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.624450 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.624537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.624621 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.624716 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.624809 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.624896 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.624981 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.625080 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.625168 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.625262 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.625337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.625415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.625494 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.626107 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.626254 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.626368 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.626447 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.626529 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.626609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.626708 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.626796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.626901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.626991 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.627076 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.627169 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.627256 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.627350 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.627437 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.627522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.627607 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.627700 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.627793 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.627893 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.627981 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.628066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.628158 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.628244 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.628337 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.628437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.628531 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.628632 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.628720 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.628805 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.628959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.629062 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.629158 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.629251 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.629339 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.629432 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.629532 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.629627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.629714 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.629807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.629807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.630058 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.630147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.630232 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.630348 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.630451 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.630540 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.630635 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.630724 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.630799 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.630799 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.630799 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.630996 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.631095 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.631183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.631280 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.631396 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.631531 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.631645 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.631736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.631822 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.631915 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.632001 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.632087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.632186 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.632281 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.632375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.632469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.632555 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.632640 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.632770 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.632876 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.633050 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.633155 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.633251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.633343 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.633418 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.633497 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.633586 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.633667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.633753 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.633841 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.633934 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.634021 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.634106 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.634191 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.634285 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.634406 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.634489 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.634577 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.634670 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.634767 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.634854 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.634947 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.635033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.635132 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.635220 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.635315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.635459 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.635592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.635703 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.635800 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.635887 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.635982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.636075 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.636162 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.636247 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.636327 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.636400 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.636483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.636563 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.636643 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.636730 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.636811 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.636907 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.636995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.637080 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.637174 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.637267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.637362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.637464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.637551 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.637697 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.637833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.638016 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.638111 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.638346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.638482 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.638668 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.638767 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.638994 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.639105 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.639323 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.639478 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.639628 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.639726 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.639945 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.640151 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.640268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.640364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.640604 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.640716 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.640879 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.640986 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.641278 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.641530 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.642007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.642119 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.642356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.642455 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.642691 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.642804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.643022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.643118 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.643353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.643457 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.643723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.643880 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.643973 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.644063 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.644287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.644395 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.644599 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.644705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.644914 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.645023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.645508 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.645617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.645827 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.645932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.646139 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.646248 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.646478 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.646574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.646794 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.646906 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.647105 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.647206 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.647414 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.647509 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.647723 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.647825 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.648033 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.648136 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.648349 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.648456 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.648653 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.648761 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.648964 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.649066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.649275 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.649382 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.649587 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.649695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.649895 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.649996 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.650224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.650383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.650563 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.650660 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.650873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.650975 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.651184 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.651288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.651495 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.651592 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.651828 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.651921 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.652141 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.652415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.652513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.652601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.652782 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.652887 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.653099 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.653208 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.653447 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.653542 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.653832 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.653948 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.654068 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.654257 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.654385 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.654475 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.654696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.654799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.655006 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.655110 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.655319 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.655470 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.655634 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.655766 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.655945 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.656041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.656262 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.656357 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.656577 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.656674 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.657584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.657703 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.657982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.658243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.658416 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.658611 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.658726 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.658935 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.659099 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.659240 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.659345 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.659557 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.659667 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.659871 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.659974 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.660182 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.660286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.660498 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.660603 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.660813 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.660916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.661123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.661219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.661423 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.661532 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.661737 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.661841 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.662060 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.662164 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.662392 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.662493 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.664932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.665072 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.665167 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.665266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.665368 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.665463 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.665560 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.665656 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.665808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.665943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.666040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.666136 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.666236 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.666385 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.666486 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.666583 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.666784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.666927 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.667033 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.667123 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:57:02.667210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.667210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.667210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.667210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.667210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.667608 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.667608 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.667851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.668164 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.668473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.668784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.669094 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.669406 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.669715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.670030 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.670386 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.670718 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.671035 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.671346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.671658 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.671969 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.672318 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.672810 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.673185 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.673495 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.673819 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.674149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.674490 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.674824 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.675139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.675449 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.675772 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.676092 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.676411 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.676743 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.677032 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.677361 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.677679 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.677995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.678340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.678672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.679002 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.679313 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.679627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.679948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.680261 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.680577 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.680892 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.681207 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.681525 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.681844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.682161 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.682501 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.682814 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.683129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.683440 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.683751 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.684167 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.684444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.684755 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.685070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.685377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.685694 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.686006 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.686465 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.686786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.687106 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.687415 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.687731 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.688561 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.688993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.689315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.689628 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.690165 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.690407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.690727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.691048 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.691387 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.691671 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.692032 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.692315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.692627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.692939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.693251 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.693580 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.693896 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.694280 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699296 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699296 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699296 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699296 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699296 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699296 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699296 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699296 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.699914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.700502 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.700502 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.700502 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.700739 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.701012 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.701436 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.701766 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.702084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.702690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.703021 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.703335 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.703648 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.704025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.704503 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.704654 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.704986 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.705299 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.705615 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.705936 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.706253 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.706589 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.706901 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.707237 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.707544 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.707875 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.708709 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.709040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.709370 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.709688 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.710017 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.710357 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.710666 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.710979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.711292 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.711644 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.711956 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.712321 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.712616 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.712953 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.713270 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.713610 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.713943 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.714266 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.714616 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.714947 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.715259 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.715572 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.715887 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.716199 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.716509 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.716821 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.717136 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.717446 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.717754 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.718062 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.718413 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.718903 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.719041 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.719386 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.719706 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.720016 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.720327 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.720700 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.721014 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.721354 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.721681 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.722011 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.722366 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.722687 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.723020 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.723345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.723668 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.723994 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.724318 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.724658 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.724965 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.725284 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.725602 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.725923 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.726247 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.726601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.727084 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO dbcounter [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] Registered counter for database nova_api May 26 16:57:02.727193 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.727486 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.727811 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.728129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.728449 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.728771 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.729093 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.729412 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.729736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.730051 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.730394 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.730734 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.731065 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.731399 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.731741 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.732093 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.732381 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.732700 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.733021 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.733385 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.733709 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.734024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.734363 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.734781 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.735034 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.735355 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.735676 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.735996 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.736317 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.736691 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.736948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.737266 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.737591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.737920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.738261 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.738611 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.738929 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.739249 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.739578 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.740110 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.740431 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.740772 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.741101 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.741434 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.741754 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.742078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.742702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.742883 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.743229 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.743454 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.743779 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.744077 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.744406 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.744724 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.745041 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.745366 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.745682 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.746247 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.746656 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.746988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.747308 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.747642 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.747970 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.748077 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_db.sqlalchemy.engines [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:57:02.748283 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.748615 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.748980 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.749239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.749567 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.749885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.750197 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.750535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.751374 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.751691 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.752005 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.752323 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.752635 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.752969 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.753284 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.753599 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.753912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.754232 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.754570 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.754885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.755198 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.755508 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.755829 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.756140 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.756453 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.756632 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writer thread running {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:57:02.756765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.757085 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.757397 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.757712 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.758073 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.758432 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.758796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.759114 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.759437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.759756 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.760091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.760410 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.760728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.761085 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.761409 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.761966 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.762310 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.762671 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.763015 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.763354 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.763671 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.763984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.764300 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.764631 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.764949 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.765265 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.765579 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.765899 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.766239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.766603 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.767014 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.767239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.767554 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.767868 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.768185 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.768501 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.768817 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.769212 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.769485 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.769819 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.770144 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.770490 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.770817 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.771134 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.771451 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.771771 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.772088 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.772411 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.772751 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.773071 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.773383 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.773823 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.774146 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.774496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.774828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.775146 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.775474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.775802 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.776122 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.776451 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.776768 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.777108 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.777454 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.777788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.778121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.778456 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.778771 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.779084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.779399 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.779723 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.780044 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.780354 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.780664 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.780975 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.781283 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.781592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.782448 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.782759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.783149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.783476 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.783788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.784100 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.784410 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.784721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.785030 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.785348 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.785656 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.785968 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.786277 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.786609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.786995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.787309 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.787743 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.787972 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.788304 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.788623 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.788951 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.789264 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.789592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.789928 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.790249 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.790621 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.813927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.813927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.813927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.813927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.813927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.813927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.813927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.813927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.814597 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.814597 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.814597 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.814597 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.814597 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.814597 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.814597 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.814597 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.815808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.816330 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.816330 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.816330 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:57:02.816330 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:57:02.816586 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.context [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e260859a-6023-4cf2-a86b-d32d2bdb7fbd(cell1) {{(pid=130525) load_cells /opt/stack/nova/nova/context.py:464}} May 26 16:57:02.819867 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:02.821484 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:02.822297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:02.824295 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:02.826273 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO dbcounter [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] Registered counter for database nova_cell0 May 26 16:57:02.831264 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO dbcounter [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] Registered counter for database nova_cell1 May 26 16:57:02.838556 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_db.sqlalchemy.engines [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:57:02.840378 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_db.sqlalchemy.engines [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:57:02.847557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writer thread running {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:57:02.849637 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writer thread running {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:57:02.863914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO dbcounter [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] Registered counter for database nova_api May 26 16:57:02.883753 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_db.sqlalchemy.engines [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:57:02.890709 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writer thread running {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:57:02.948738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.context [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e260859a-6023-4cf2-a86b-d32d2bdb7fbd(cell1) {{(pid=130526) load_cells /opt/stack/nova/nova/context.py:464}} May 26 16:57:02.953230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:02.955670 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:02.956501 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:02.958545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:02.960516 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO dbcounter [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] Registered counter for database nova_cell0 May 26 16:57:02.964660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO dbcounter [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] Registered counter for database nova_cell1 May 26 16:57:02.972108 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_db.sqlalchemy.engines [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:57:02.974490 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_db.sqlalchemy.engines [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:57:02.992461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writer thread running {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:57:02.992461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writer thread running {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:57:03.002525 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO dbcounter [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] Registered counter for database nova_cell0 May 26 16:57:03.009048 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_db.sqlalchemy.engines [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:57:03.013340 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writer thread running {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:57:03.131205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO dbcounter [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] Registered counter for database nova_cell0 May 26 16:57:03.138487 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_db.sqlalchemy.engines [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:57:03.143443 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writer thread running {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:57:03.351893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: WARNING keystonemiddleware.auth_token [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:57:03.359640 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: WARNING keystonemiddleware.auth_token [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:57:03.475639 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: WARNING keystonemiddleware.auth_token [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:57:03.483238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: WARNING keystonemiddleware.auth_token [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:57:03.718076 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: WARNING keystonemiddleware.auth_token [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:57:03.724262 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: WARNING keystonemiddleware.auth_token [None req-2451c8d4-6032-4e46-95d8-675812216514 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:57:03.729589 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5649d57519c0 pid: 130525 (default app) May 26 16:57:03.831195 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: WARNING keystonemiddleware.auth_token [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:57:03.837277 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: WARNING keystonemiddleware.auth_token [None req-de5ba90e-21bf-4102-a54d-0c5ad914f9d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:57:03.842654 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5649d57519c0 pid: 130526 (default app) May 26 16:57:50.882482 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=3 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:50.883846 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=3 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:50.908828 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=3 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:50.914593 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=3 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:51.821496 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2035568822", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "networks": [{"uuid": "e3627449-bd3a-4594-927f-9fc0738a8dfe"}]}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:52.364229 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] validate_networks() for [('e3627449-bd3a-4594-927f-9fc0738a8dfe', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:57:54.796535 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:57:54.797070 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:57:54.797364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:57:54.797979 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:57:54.798590 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:57:54.816545 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:54.817297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:54.818687 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:54.819478 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:54.873864 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Getting quotas for project 642e24c7c239432b93d0e03f7022cc0e. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:57:54.882501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Getting quotas for user 5bdb3e36e5934d1fbf2204cac57be139 and project 642e24c7c239432b93d0e03f7022cc0e. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:57:54.931184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:57:54.960810 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:57:55.202251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b86cfde6-7169-4c02-b08d-46c493a19356 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.337008 May 26 16:57:55.205025 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 1/1] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 16:57:50 2022] POST /compute/v2.1/servers => generated 382 bytes in 4347 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:57:55.678653 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1db35f9f-b122-444e-b7b7-88e8839228b2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:55.679421 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1db35f9f-b122-444e-b7b7-88e8839228b2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:55.705849 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=3 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:55.706880 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=3 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:55.707675 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=3 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:55.708593 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=3 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:56.416146 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1db35f9f-b122-444e-b7b7-88e8839228b2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:56.434666 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1db35f9f-b122-444e-b7b7-88e8839228b2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1219 microversion: 2.1 time: 1.222345 May 26 16:57:56.440733 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 1/2] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:57:55 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1219 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:56.962812 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c84a8475-ad67-491d-9cd9-1dbf255127ac tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: .version_select at 0x7fd252e56a60>, body: {"keypair": {"name": "tempest-keypair-863389433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzJ5GN0gVf34DDyH4F+v/XxDUfKAix3TNXwbP+TATjfK4x1UAeOCysS2DgTQHR6BGOeQtrCHXapaSKXrDVMWLaXl8geVjWiQMvbvQE1vMOzm0996eV3F6LNDncdGXYtLg=="}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:56.999846 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-c84a8475-ad67-491d-9cd9-1dbf255127ac tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'key_pairs'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:57:57.012289 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-c84a8475-ad67-491d-9cd9-1dbf255127ac tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for user 289cb250e20344d28bd5fd17255d5896 and project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'key_pairs'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:57:57.169313 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c84a8475-ad67-491d-9cd9-1dbf255127ac tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.288409 May 26 16:57:57.170159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 2/3] 10.222.0.112 () {60 vars in 1163 bytes} [Thu May 26 16:57:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:57:57.456029 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-30524265-088d-48a4-904f-b1b9e340af81 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:57.457803 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-30524265-088d-48a4-904f-b1b9e340af81 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:57.708068 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-30524265-088d-48a4-904f-b1b9e340af81 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:57.728900 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-30524265-088d-48a4-904f-b1b9e340af81 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1219 microversion: 2.1 time: 0.278128 May 26 16:57:57.729483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 2/4] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:57:57 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1219 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:58.747559 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-06a74a8e-be3a-4e06-8bd9-fd0a5824a956 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:58.749112 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-06a74a8e-be3a-4e06-8bd9-fd0a5824a956 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:58.786923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-06a74a8e-be3a-4e06-8bd9-fd0a5824a956 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:58.787504 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-06a74a8e-be3a-4e06-8bd9-fd0a5824a956 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:58.789533 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-06a74a8e-be3a-4e06-8bd9-fd0a5824a956 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:58.791120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-06a74a8e-be3a-4e06-8bd9-fd0a5824a956 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:59.556354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-06a74a8e-be3a-4e06-8bd9-fd0a5824a956 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:59.583394 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-06a74a8e-be3a-4e06-8bd9-fd0a5824a956 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1223 microversion: 2.1 time: 0.840349 May 26 16:57:59.587276 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 3/5] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:57:58 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1223 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:00.605846 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bb36376b-cca8-4c47-84ae-732c7c759b2f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:00.606717 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bb36376b-cca8-4c47-84ae-732c7c759b2f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:00.619426 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bb36376b-cca8-4c47-84ae-732c7c759b2f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:00.619876 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bb36376b-cca8-4c47-84ae-732c7c759b2f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:00.620667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bb36376b-cca8-4c47-84ae-732c7c759b2f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:00.621106 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bb36376b-cca8-4c47-84ae-732c7c759b2f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:01.043557 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bb36376b-cca8-4c47-84ae-732c7c759b2f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:01.077343 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bb36376b-cca8-4c47-84ae-732c7c759b2f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1271 microversion: 2.1 time: 0.475476 May 26 16:58:01.080602 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 3/6] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:00 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1271 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:01.966425 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8b41d746-edf6-491f-b90f-c108e52bec62 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Action: 'create', calling method: .version_select at 0x7fd251590f70>, body: {"keypair": {"name": "tempest-keypair-758420915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHy8Ewn0BFi/udOFrlgz0J5MDt+VUQB6J+uX3JhBAdN0ZQYlQLQjAYLcPDK0suzPQ5qF+mZHEq0mfv2IeWXIQI2fO6V0dfJYiVfUbCLV+Vv6FpzHd7TVpFFQs+1EucGAdQ=="}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:02.000209 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-8b41d746-edf6-491f-b90f-c108e52bec62 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Getting quotas for project 6f18b754d17d4ded958a80cf2781c72b. Resources: {'key_pairs'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:02.009113 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-8b41d746-edf6-491f-b90f-c108e52bec62 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Getting quotas for user 8207acca876a4af5ac75dd4283916763 and project 6f18b754d17d4ded958a80cf2781c72b. Resources: {'key_pairs'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:02.106430 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ca94eb8e-6866-477e-8e2f-4f4542dc5931 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:02.106430 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ca94eb8e-6866-477e-8e2f-4f4542dc5931 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:02.119250 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ca94eb8e-6866-477e-8e2f-4f4542dc5931 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:02.121010 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ca94eb8e-6866-477e-8e2f-4f4542dc5931 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:02.123474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ca94eb8e-6866-477e-8e2f-4f4542dc5931 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:02.123905 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ca94eb8e-6866-477e-8e2f-4f4542dc5931 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:02.134989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8b41d746-edf6-491f-b90f-c108e52bec62 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.598412 May 26 16:58:02.135592 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 4/7] 10.222.0.112 () {60 vars in 1163 bytes} [Thu May 26 16:58:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:02.324435 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ca94eb8e-6866-477e-8e2f-4f4542dc5931 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:02.338728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ca94eb8e-6866-477e-8e2f-4f4542dc5931 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1271 microversion: 2.1 time: 0.246910 May 26 16:58:02.343034 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 4/8] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:02 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:03.359293 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0260571c-d8e3-4b83-8ec0-467c2adfc32a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:03.359981 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0260571c-d8e3-4b83-8ec0-467c2adfc32a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:03.372043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0260571c-d8e3-4b83-8ec0-467c2adfc32a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:03.372727 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0260571c-d8e3-4b83-8ec0-467c2adfc32a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:03.373710 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0260571c-d8e3-4b83-8ec0-467c2adfc32a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:03.374485 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0260571c-d8e3-4b83-8ec0-467c2adfc32a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:03.470064 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0260571c-d8e3-4b83-8ec0-467c2adfc32a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:03.481361 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0260571c-d8e3-4b83-8ec0-467c2adfc32a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1271 microversion: 2.1 time: 0.125622 May 26 16:58:03.483123 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 5/9] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:03 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:04.117327 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1012531795", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "685d481c-e3f1-425b-9a28-548fe43d099c"}], "security_groups": [{"name": "tempest-securitygroup--1288678646"}], "key_name": "tempest-keypair-863389433", "user_data": "}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:04.286984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f6f6deca-4172-4c44-b855-eb73b32adc4e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Action: 'create', calling method: .version_select at 0x7fd252e05b80>, body: {"keypair": {"name": "tempest-keypair-1421629834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtOJIkUCxpOQy/g5xAcqljNUMCybY7yqCGQqghZMyhxHad5hp9dSkN2oAGJsqg5VzKNAaIa6vIfLDetDd4cmZTMX2s6O85Jl9d9cA01hD9uYAwaD58dZeIiB7ziXhImCA=="}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:04.331112 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] validate_networks() for [('685d481c-e3f1-425b-9a28-548fe43d099c', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:58:04.353518 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-f6f6deca-4172-4c44-b855-eb73b32adc4e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Getting quotas for project 0c9ae847a0d449ab9c875f8a4f936d6a. Resources: {'key_pairs'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:04.362061 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-f6f6deca-4172-4c44-b855-eb73b32adc4e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Getting quotas for user 9e09f6a92f064ec78231fa06782bafda and project 0c9ae847a0d449ab9c875f8a4f936d6a. Resources: {'key_pairs'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:04.558538 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f6f6deca-4172-4c44-b855-eb73b32adc4e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.535827 May 26 16:58:04.559748 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 5/10] 10.222.0.112 () {62 vars in 1204 bytes} [Thu May 26 16:58:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 538 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 16:58:04.565103 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bf4fa0a1-d352-4dcb-9d77-3d80e0b47e7e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:04.567043 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bf4fa0a1-d352-4dcb-9d77-3d80e0b47e7e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:04.598867 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bf4fa0a1-d352-4dcb-9d77-3d80e0b47e7e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:04.598867 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bf4fa0a1-d352-4dcb-9d77-3d80e0b47e7e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:04.602362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bf4fa0a1-d352-4dcb-9d77-3d80e0b47e7e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:04.602848 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bf4fa0a1-d352-4dcb-9d77-3d80e0b47e7e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:04.784589 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bf4fa0a1-d352-4dcb-9d77-3d80e0b47e7e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:04.801273 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bf4fa0a1-d352-4dcb-9d77-3d80e0b47e7e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1271 microversion: 2.1 time: 0.240414 May 26 16:58:04.803748 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 6/11] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:04 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:04.837662 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:05.731715 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:58:05.733603 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:58:05.734542 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:58:05.735197 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:58:05.736346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:58:05.762699 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.763301 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.764199 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.764637 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.815546 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:05.820583 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for user 289cb250e20344d28bd5fd17255d5896 and project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:05.821435 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dc1cadea-6116-48b3-bb0c-9809fedaa377 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:05.822238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-dc1cadea-6116-48b3-bb0c-9809fedaa377 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:05.837067 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dc1cadea-6116-48b3-bb0c-9809fedaa377 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.837525 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dc1cadea-6116-48b3-bb0c-9809fedaa377 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.838308 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dc1cadea-6116-48b3-bb0c-9809fedaa377 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.843432 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dc1cadea-6116-48b3-bb0c-9809fedaa377 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.866623 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:58:05.881737 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:58:05.935681 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dc1cadea-6116-48b3-bb0c-9809fedaa377 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:05.945274 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-dc1cadea-6116-48b3-bb0c-9809fedaa377 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1271 microversion: 2.1 time: 0.128664 May 26 16:58:05.946648 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 7/12] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:05 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:06.132014 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f522c33e-b412-4f20-8ce4-d01f669acdd4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.016281 May 26 16:58:06.135985 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 6/13] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 16:58:04 2022] POST /compute/v2.1/servers => generated 404 bytes in 2025 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 16:58:06.143722 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7eee4ce3-df08-4dd9-baa9-82d3c3dd3c9b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:06.144520 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7eee4ce3-df08-4dd9-baa9-82d3c3dd3c9b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:06.333693 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7eee4ce3-df08-4dd9-baa9-82d3c3dd3c9b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:06.352427 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7eee4ce3-df08-4dd9-baa9-82d3c3dd3c9b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1245 microversion: 2.1 time: 0.210818 May 26 16:58:06.355961 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 8/14] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:06 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1245 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:06.965234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1ec20815-663c-4dff-8899-61b4198b2e58 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:06.965870 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1ec20815-663c-4dff-8899-61b4198b2e58 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:06.987702 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1ec20815-663c-4dff-8899-61b4198b2e58 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:06.990138 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1ec20815-663c-4dff-8899-61b4198b2e58 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:06.994014 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1ec20815-663c-4dff-8899-61b4198b2e58 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:06.995773 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1ec20815-663c-4dff-8899-61b4198b2e58 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:07.171975 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1ec20815-663c-4dff-8899-61b4198b2e58 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:07.185170 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1ec20815-663c-4dff-8899-61b4198b2e58 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1271 microversion: 2.1 time: 0.224688 May 26 16:58:07.186994 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 7/15] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:06 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:07.371174 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ad9fc92b-00dd-4345-b212-d449ab08deb9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:07.372400 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ad9fc92b-00dd-4345-b212-d449ab08deb9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:07.393291 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1796895605", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e270676-3704-4c21-93c0-8b36f5ceb9d6"}], "security_groups": [{"name": "tempest-securitygroup--1448421447"}], "key_name": "tempest-keypair-758420915", "user_data": "}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:07.654674 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] validate_networks() for [('3e270676-3704-4c21-93c0-8b36f5ceb9d6', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:58:08.016207 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ad9fc92b-00dd-4345-b212-d449ab08deb9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:08.021765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ad9fc92b-00dd-4345-b212-d449ab08deb9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1245 microversion: 2.1 time: 0.654274 May 26 16:58:08.022314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 9/16] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:07 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1245 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:08.205312 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6a07c3b0-1f41-4105-97ed-7f3ed36742db tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:08.206075 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6a07c3b0-1f41-4105-97ed-7f3ed36742db tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:08.215840 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6a07c3b0-1f41-4105-97ed-7f3ed36742db tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:08.220673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6a07c3b0-1f41-4105-97ed-7f3ed36742db tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:08.221715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6a07c3b0-1f41-4105-97ed-7f3ed36742db tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:08.222306 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6a07c3b0-1f41-4105-97ed-7f3ed36742db tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:08.541117 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6a07c3b0-1f41-4105-97ed-7f3ed36742db tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:08.553959 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6a07c3b0-1f41-4105-97ed-7f3ed36742db tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1277 microversion: 2.1 time: 0.353474 May 26 16:58:08.559143 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 10/17] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:08 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1277 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:09.039889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-712295bf-bd3a-42bc-9945-b21b784dbd79 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:09.040338 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-712295bf-bd3a-42bc-9945-b21b784dbd79 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:09.057097 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-712295bf-bd3a-42bc-9945-b21b784dbd79 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.057097 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-712295bf-bd3a-42bc-9945-b21b784dbd79 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.057097 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-712295bf-bd3a-42bc-9945-b21b784dbd79 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.057097 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-712295bf-bd3a-42bc-9945-b21b784dbd79 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.229370 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-712295bf-bd3a-42bc-9945-b21b784dbd79 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:09.250254 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-712295bf-bd3a-42bc-9945-b21b784dbd79 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1249 microversion: 2.1 time: 0.214162 May 26 16:58:09.252754 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 11/18] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:09 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1249 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:09.303997 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:58:09.305168 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:58:09.305832 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:58:09.306455 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:58:09.307584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:58:09.320181 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.320865 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.321882 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.322562 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.363226 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Getting quotas for project 6f18b754d17d4ded958a80cf2781c72b. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:09.369764 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Getting quotas for user 8207acca876a4af5ac75dd4283916763 and project 6f18b754d17d4ded958a80cf2781c72b. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:09.403509 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:58:09.408039 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:58:09.574431 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7f60fa0c-5611-4d89-bdcf-f0c924f0d192 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:09.575099 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7f60fa0c-5611-4d89-bdcf-f0c924f0d192 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:09.582172 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f60fa0c-5611-4d89-bdcf-f0c924f0d192 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.582646 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f60fa0c-5611-4d89-bdcf-f0c924f0d192 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.583663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f60fa0c-5611-4d89-bdcf-f0c924f0d192 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.584106 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f60fa0c-5611-4d89-bdcf-f0c924f0d192 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.668850 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-83f21548-f4e4-4a21-9705-6700721f5521 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.281505 May 26 16:58:09.669554 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 8/19] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 16:58:07 2022] POST /compute/v2.1/servers => generated 404 bytes in 2284 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 16:58:09.699554 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1648483704", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5337a038-4616-4e5a-8535-a7a6c1c64f71"}], "security_groups": [{"name": "tempest-securitygroup--949261521"}], "key_name": "tempest-keypair-1421629834", "user_data": "}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:09.745722 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7f60fa0c-5611-4d89-bdcf-f0c924f0d192 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:09.760429 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7f60fa0c-5611-4d89-bdcf-f0c924f0d192 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1277 microversion: 2.1 time: 0.189750 May 26 16:58:09.761433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 12/20] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:09 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:09.793690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-fb58d204-9bb4-4d91-9f71-08b465543b60 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:09.794381 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-fb58d204-9bb4-4d91-9f71-08b465543b60 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:09.924824 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fb58d204-9bb4-4d91-9f71-08b465543b60 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:09.937717 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-fb58d204-9bb4-4d91-9f71-08b465543b60 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1241 microversion: 2.1 time: 0.159900 May 26 16:58:09.957131 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 13/21] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:09 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:10.271062 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-cc0c5037-c6eb-4d4d-b83f-c336dd640e30 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:10.271963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-cc0c5037-c6eb-4d4d-b83f-c336dd640e30 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:10.281681 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cc0c5037-c6eb-4d4d-b83f-c336dd640e30 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:10.283175 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cc0c5037-c6eb-4d4d-b83f-c336dd640e30 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:10.288746 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cc0c5037-c6eb-4d4d-b83f-c336dd640e30 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:10.289602 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cc0c5037-c6eb-4d4d-b83f-c336dd640e30 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:10.417150 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] validate_networks() for [('5337a038-4616-4e5a-8535-a7a6c1c64f71', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:58:10.433429 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cc0c5037-c6eb-4d4d-b83f-c336dd640e30 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:10.443014 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-cc0c5037-c6eb-4d4d-b83f-c336dd640e30 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1297 microversion: 2.1 time: 0.177518 May 26 16:58:10.450407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 14/22] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:10 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1297 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:10.777857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-75c530b0-8424-483b-be30-0c808461c1c2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:10.778549 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-75c530b0-8424-483b-be30-0c808461c1c2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:10.787209 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-75c530b0-8424-483b-be30-0c808461c1c2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:10.787932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-75c530b0-8424-483b-be30-0c808461c1c2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:10.788862 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-75c530b0-8424-483b-be30-0c808461c1c2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:10.789444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-75c530b0-8424-483b-be30-0c808461c1c2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.263369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:58:11.263369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:58:11.263369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:58:11.263369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:58:11.263369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:58:11.264369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.264369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.264369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.264369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.265147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Getting quotas for project 0c9ae847a0d449ab9c875f8a4f936d6a. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:11.265147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Getting quotas for user 9e09f6a92f064ec78231fa06782bafda and project 0c9ae847a0d449ab9c875f8a4f936d6a. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:11.265147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:58:11.265147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:58:11.265481 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-75c530b0-8424-483b-be30-0c808461c1c2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:11.265481 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-75c530b0-8424-483b-be30-0c808461c1c2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.251942 May 26 16:58:11.265481 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 15/23] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:10 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:11.265708 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:11.265792 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0d2965e3-1169-4428-8287-2d0b1efb150d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:11.265792 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0d2965e3-1169-4428-8287-2d0b1efb150d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:11.265792 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0d2965e3-1169-4428-8287-2d0b1efb150d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:11.265792 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0d2965e3-1169-4428-8287-2d0b1efb150d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1241 microversion: 2.1 time: 0.069402 May 26 16:58:11.266121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 16/24] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:11 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:11.463378 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3774cdf6-2c7b-4166-8ba9-bc097134b192 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:11.464011 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3774cdf6-2c7b-4166-8ba9-bc097134b192 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:11.472047 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3774cdf6-2c7b-4166-8ba9-bc097134b192 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.472487 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3774cdf6-2c7b-4166-8ba9-bc097134b192 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.473265 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3774cdf6-2c7b-4166-8ba9-bc097134b192 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.473789 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3774cdf6-2c7b-4166-8ba9-bc097134b192 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.539178 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3774cdf6-2c7b-4166-8ba9-bc097134b192 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:11.547833 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3774cdf6-2c7b-4166-8ba9-bc097134b192 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1297 microversion: 2.1 time: 0.088320 May 26 16:58:11.549862 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 17/25] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:11 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:11.554262 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e27286b5-3a4e-4618-924e-1f27d9b4b79e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 1.883625 May 26 16:58:11.560105 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 9/26] 10.222.0.112 () {62 vars in 1192 bytes} [Thu May 26 16:58:09 2022] POST /compute/v2.1/servers => generated 403 bytes in 1885 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 26 16:58:11.569665 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0651ef34-ca56-49e3-b5e1-4a8773af2730 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:11.570292 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0651ef34-ca56-49e3-b5e1-4a8773af2730 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:11.649107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0651ef34-ca56-49e3-b5e1-4a8773af2730 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:11.656437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0651ef34-ca56-49e3-b5e1-4a8773af2730 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:11.658195 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0651ef34-ca56-49e3-b5e1-4a8773af2730 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:11.659470 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0651ef34-ca56-49e3-b5e1-4a8773af2730 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1286 microversion: 2.20 time: 0.095932 May 26 16:58:11.660094 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 18/27] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:11 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:12.043737 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-faeb4e4f-e801-46b6-b7ce-9aabe8ae4602 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:12.044546 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-faeb4e4f-e801-46b6-b7ce-9aabe8ae4602 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:12.051817 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-faeb4e4f-e801-46b6-b7ce-9aabe8ae4602 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:12.052348 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-faeb4e4f-e801-46b6-b7ce-9aabe8ae4602 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.053192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-faeb4e4f-e801-46b6-b7ce-9aabe8ae4602 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:12.053704 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-faeb4e4f-e801-46b6-b7ce-9aabe8ae4602 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.220256 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-faeb4e4f-e801-46b6-b7ce-9aabe8ae4602 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:12.229080 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-faeb4e4f-e801-46b6-b7ce-9aabe8ae4602 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.189310 May 26 16:58:12.229774 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 10/28] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:12 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:12.276942 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-cd74308c-a285-4c73-8ed3-e2b6649cf0f9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:12.284270 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-cd74308c-a285-4c73-8ed3-e2b6649cf0f9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:12.305459 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cd74308c-a285-4c73-8ed3-e2b6649cf0f9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:12.308362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cd74308c-a285-4c73-8ed3-e2b6649cf0f9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.308362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cd74308c-a285-4c73-8ed3-e2b6649cf0f9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:12.308362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cd74308c-a285-4c73-8ed3-e2b6649cf0f9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.387846 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cd74308c-a285-4c73-8ed3-e2b6649cf0f9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:12.396985 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-cd74308c-a285-4c73-8ed3-e2b6649cf0f9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.123686 May 26 16:58:12.397592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 19/29] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:12 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:12.566663 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b443b1ac-5de3-4b57-aaa3-ffcacfb35ece tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:12.572512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b443b1ac-5de3-4b57-aaa3-ffcacfb35ece tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:12.576026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b443b1ac-5de3-4b57-aaa3-ffcacfb35ece tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:12.576497 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b443b1ac-5de3-4b57-aaa3-ffcacfb35ece tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.577263 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b443b1ac-5de3-4b57-aaa3-ffcacfb35ece tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:12.577732 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b443b1ac-5de3-4b57-aaa3-ffcacfb35ece tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.649789 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b443b1ac-5de3-4b57-aaa3-ffcacfb35ece tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:12.657638 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b443b1ac-5de3-4b57-aaa3-ffcacfb35ece tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1297 microversion: 2.1 time: 0.096141 May 26 16:58:12.658630 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 11/30] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:12 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:12.679593 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dd17edf8-cc9d-4c6c-aaab-3f8a59e4aeaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:12.679593 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-dd17edf8-cc9d-4c6c-aaab-3f8a59e4aeaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:12.732739 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dd17edf8-cc9d-4c6c-aaab-3f8a59e4aeaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:12.742742 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dd17edf8-cc9d-4c6c-aaab-3f8a59e4aeaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:12.744308 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dd17edf8-cc9d-4c6c-aaab-3f8a59e4aeaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:12.745570 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-dd17edf8-cc9d-4c6c-aaab-3f8a59e4aeaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1286 microversion: 2.20 time: 0.070645 May 26 16:58:12.746257 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 20/31] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:12 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:13.251479 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-895f281d-4fa9-49cc-a220-73901cd7c946 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:13.258454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-895f281d-4fa9-49cc-a220-73901cd7c946 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:13.258454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-895f281d-4fa9-49cc-a220-73901cd7c946 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.258454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-895f281d-4fa9-49cc-a220-73901cd7c946 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.259243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-895f281d-4fa9-49cc-a220-73901cd7c946 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.259682 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-895f281d-4fa9-49cc-a220-73901cd7c946 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.400838 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-895f281d-4fa9-49cc-a220-73901cd7c946 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:13.408949 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-895f281d-4fa9-49cc-a220-73901cd7c946 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.161712 May 26 16:58:13.409527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 12/32] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:13 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:13.414134 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f2f06bcc-4360-4e64-85c8-396a2b67a89a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:13.414838 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f2f06bcc-4360-4e64-85c8-396a2b67a89a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:13.420789 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f2f06bcc-4360-4e64-85c8-396a2b67a89a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.421249 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f2f06bcc-4360-4e64-85c8-396a2b67a89a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.421997 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f2f06bcc-4360-4e64-85c8-396a2b67a89a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.422432 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f2f06bcc-4360-4e64-85c8-396a2b67a89a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.490679 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f2f06bcc-4360-4e64-85c8-396a2b67a89a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:13.498081 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f2f06bcc-4360-4e64-85c8-396a2b67a89a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.087744 May 26 16:58:13.498680 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 21/33] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:13 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:13.675725 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-656a3edf-de61-4c8c-b9ff-317305a73f32 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:13.676331 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-656a3edf-de61-4c8c-b9ff-317305a73f32 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:13.682113 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-656a3edf-de61-4c8c-b9ff-317305a73f32 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.682537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-656a3edf-de61-4c8c-b9ff-317305a73f32 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.683292 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-656a3edf-de61-4c8c-b9ff-317305a73f32 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.683729 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-656a3edf-de61-4c8c-b9ff-317305a73f32 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.745801 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-656a3edf-de61-4c8c-b9ff-317305a73f32 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:13.753752 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-656a3edf-de61-4c8c-b9ff-317305a73f32 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1297 microversion: 2.1 time: 0.082341 May 26 16:58:13.758155 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 13/34] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:13 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:13.764864 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-75218eea-2a83-4a1a-8a72-1f9265ea71e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:13.765609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-75218eea-2a83-4a1a-8a72-1f9265ea71e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:13.771995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-75218eea-2a83-4a1a-8a72-1f9265ea71e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.772441 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-75218eea-2a83-4a1a-8a72-1f9265ea71e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.773189 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-75218eea-2a83-4a1a-8a72-1f9265ea71e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.773619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-75218eea-2a83-4a1a-8a72-1f9265ea71e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.838768 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-75218eea-2a83-4a1a-8a72-1f9265ea71e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:13.847471 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-75218eea-2a83-4a1a-8a72-1f9265ea71e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:13.848992 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-75218eea-2a83-4a1a-8a72-1f9265ea71e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:13.850095 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-75218eea-2a83-4a1a-8a72-1f9265ea71e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.089138 May 26 16:58:13.850689 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 22/35] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:13 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:14.426522 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8abffd38-447b-4200-8dbe-725fe83bf250 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:14.427147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8abffd38-447b-4200-8dbe-725fe83bf250 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:14.433078 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8abffd38-447b-4200-8dbe-725fe83bf250 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:14.433812 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8abffd38-447b-4200-8dbe-725fe83bf250 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:14.434626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8abffd38-447b-4200-8dbe-725fe83bf250 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:14.435069 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8abffd38-447b-4200-8dbe-725fe83bf250 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:14.517282 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c43294c1-67ed-4097-8233-0a6a23896e03 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:14.517897 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c43294c1-67ed-4097-8233-0a6a23896e03 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:14.524184 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c43294c1-67ed-4097-8233-0a6a23896e03 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:14.524640 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c43294c1-67ed-4097-8233-0a6a23896e03 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:14.525641 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c43294c1-67ed-4097-8233-0a6a23896e03 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:14.526080 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c43294c1-67ed-4097-8233-0a6a23896e03 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:14.588175 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c43294c1-67ed-4097-8233-0a6a23896e03 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:14.596276 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c43294c1-67ed-4097-8233-0a6a23896e03 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.082993 May 26 16:58:14.596848 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 23/36] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:14 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:14.611759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8abffd38-447b-4200-8dbe-725fe83bf250 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:14.617773 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8abffd38-447b-4200-8dbe-725fe83bf250 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.195941 May 26 16:58:14.618387 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 14/37] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:14 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:14.770165 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1b5c3545-a2f0-4df1-acb2-bad92a560195 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:14.770819 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1b5c3545-a2f0-4df1-acb2-bad92a560195 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:14.776886 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1b5c3545-a2f0-4df1-acb2-bad92a560195 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:14.777315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1b5c3545-a2f0-4df1-acb2-bad92a560195 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:14.778082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1b5c3545-a2f0-4df1-acb2-bad92a560195 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:14.778546 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1b5c3545-a2f0-4df1-acb2-bad92a560195 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:14.842191 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1b5c3545-a2f0-4df1-acb2-bad92a560195 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:14.850234 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1b5c3545-a2f0-4df1-acb2-bad92a560195 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1297 microversion: 2.1 time: 0.083943 May 26 16:58:14.850835 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 24/38] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:14 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:14.868665 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b9488c8e-9ad1-4adf-a1ca-f00fddec4eea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:14.869316 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b9488c8e-9ad1-4adf-a1ca-f00fddec4eea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:14.879036 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b9488c8e-9ad1-4adf-a1ca-f00fddec4eea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:14.879036 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b9488c8e-9ad1-4adf-a1ca-f00fddec4eea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:14.879036 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b9488c8e-9ad1-4adf-a1ca-f00fddec4eea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:14.879036 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b9488c8e-9ad1-4adf-a1ca-f00fddec4eea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:14.941449 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b9488c8e-9ad1-4adf-a1ca-f00fddec4eea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:14.949382 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b9488c8e-9ad1-4adf-a1ca-f00fddec4eea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:14.951009 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b9488c8e-9ad1-4adf-a1ca-f00fddec4eea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:14.952110 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b9488c8e-9ad1-4adf-a1ca-f00fddec4eea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.087393 May 26 16:58:14.952669 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 15/39] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:14 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:15.613713 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9fa1d538-d04c-464e-ac58-25f326f9cea2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:15.614819 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9fa1d538-d04c-464e-ac58-25f326f9cea2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:15.620881 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9fa1d538-d04c-464e-ac58-25f326f9cea2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:15.621327 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9fa1d538-d04c-464e-ac58-25f326f9cea2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:15.622082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9fa1d538-d04c-464e-ac58-25f326f9cea2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:15.622643 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9fa1d538-d04c-464e-ac58-25f326f9cea2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:15.634445 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9ca61191-c478-4a17-b3b5-abb43acf1f5e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:15.635057 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9ca61191-c478-4a17-b3b5-abb43acf1f5e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:15.641011 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9ca61191-c478-4a17-b3b5-abb43acf1f5e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:15.642046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9ca61191-c478-4a17-b3b5-abb43acf1f5e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:15.642828 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9ca61191-c478-4a17-b3b5-abb43acf1f5e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:15.643265 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9ca61191-c478-4a17-b3b5-abb43acf1f5e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:15.687614 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9fa1d538-d04c-464e-ac58-25f326f9cea2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:15.699298 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9fa1d538-d04c-464e-ac58-25f326f9cea2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.089522 May 26 16:58:15.706879 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 25/40] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:15 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:15.784291 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9ca61191-c478-4a17-b3b5-abb43acf1f5e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:15.793763 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9ca61191-c478-4a17-b3b5-abb43acf1f5e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.163022 May 26 16:58:15.794530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 16/41] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:15 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:15.867788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-892da3f1-b2a8-42ba-bc5b-65cfaaf4ded9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:15.868411 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-892da3f1-b2a8-42ba-bc5b-65cfaaf4ded9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:15.874835 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-892da3f1-b2a8-42ba-bc5b-65cfaaf4ded9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:15.875464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-892da3f1-b2a8-42ba-bc5b-65cfaaf4ded9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:15.876973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-892da3f1-b2a8-42ba-bc5b-65cfaaf4ded9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:15.877568 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-892da3f1-b2a8-42ba-bc5b-65cfaaf4ded9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:15.898760 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:15.947596 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-892da3f1-b2a8-42ba-bc5b-65cfaaf4ded9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:15.956788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-892da3f1-b2a8-42ba-bc5b-65cfaaf4ded9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1297 microversion: 2.1 time: 0.093062 May 26 16:58:15.957300 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 26/42] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:15 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:15.972103 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e839678b-879c-4e7c-afe0-1885a19fe5e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:15.972725 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e839678b-879c-4e7c-afe0-1885a19fe5e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:15.983061 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e839678b-879c-4e7c-afe0-1885a19fe5e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:15.983776 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e839678b-879c-4e7c-afe0-1885a19fe5e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:15.984709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e839678b-879c-4e7c-afe0-1885a19fe5e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:15.985389 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e839678b-879c-4e7c-afe0-1885a19fe5e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:16.065275 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e839678b-879c-4e7c-afe0-1885a19fe5e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:16.073752 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e839678b-879c-4e7c-afe0-1885a19fe5e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:16.075277 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e839678b-879c-4e7c-afe0-1885a19fe5e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:16.076369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e839678b-879c-4e7c-afe0-1885a19fe5e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.109478 May 26 16:58:16.077059 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 17/43] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:15 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:16.717101 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-478f74d6-4a00-40e2-ba9e-f2013c378492 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:16.717849 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-478f74d6-4a00-40e2-ba9e-f2013c378492 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:16.726022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-478f74d6-4a00-40e2-ba9e-f2013c378492 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:16.728003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-478f74d6-4a00-40e2-ba9e-f2013c378492 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:16.728003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-478f74d6-4a00-40e2-ba9e-f2013c378492 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:16.728003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-478f74d6-4a00-40e2-ba9e-f2013c378492 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:16.814213 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-aee58e91-c119-45f0-892b-f005110ea64d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:16.815563 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-aee58e91-c119-45f0-892b-f005110ea64d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:16.825029 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-478f74d6-4a00-40e2-ba9e-f2013c378492 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:16.825139 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aee58e91-c119-45f0-892b-f005110ea64d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:16.825139 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aee58e91-c119-45f0-892b-f005110ea64d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:16.825708 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aee58e91-c119-45f0-892b-f005110ea64d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:16.827026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aee58e91-c119-45f0-892b-f005110ea64d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:16.837985 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-478f74d6-4a00-40e2-ba9e-f2013c378492 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.124979 May 26 16:58:16.847808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 27/44] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:16 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:16.975142 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dff4b24f-4857-4ac4-b379-71c846fc2eab tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:16.976066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-dff4b24f-4857-4ac4-b379-71c846fc2eab tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:16.989659 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dff4b24f-4857-4ac4-b379-71c846fc2eab tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:16.990145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dff4b24f-4857-4ac4-b379-71c846fc2eab tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:16.991214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dff4b24f-4857-4ac4-b379-71c846fc2eab tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:16.991609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dff4b24f-4857-4ac4-b379-71c846fc2eab tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:17.021121 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-aee58e91-c119-45f0-892b-f005110ea64d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:17.031444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-aee58e91-c119-45f0-892b-f005110ea64d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.224127 May 26 16:58:17.032272 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 18/45] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:16 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:17.062621 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dff4b24f-4857-4ac4-b379-71c846fc2eab tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:17.069441 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-dff4b24f-4857-4ac4-b379-71c846fc2eab tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.099793 May 26 16:58:17.070031 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 28/46] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:16 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:17.095201 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-925043dc-681a-4322-8eca-0b1e5345e1f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:17.095989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-925043dc-681a-4322-8eca-0b1e5345e1f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:17.107936 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-925043dc-681a-4322-8eca-0b1e5345e1f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:17.108410 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-925043dc-681a-4322-8eca-0b1e5345e1f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:17.109190 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-925043dc-681a-4322-8eca-0b1e5345e1f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:17.109631 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-925043dc-681a-4322-8eca-0b1e5345e1f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:17.217985 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-925043dc-681a-4322-8eca-0b1e5345e1f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:17.227248 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-925043dc-681a-4322-8eca-0b1e5345e1f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:17.228778 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-925043dc-681a-4322-8eca-0b1e5345e1f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:17.229899 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-925043dc-681a-4322-8eca-0b1e5345e1f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.138711 May 26 16:58:17.230512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 19/47] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:17 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:17.857023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-577eb90c-96be-456d-b298-9a757c4a39ee tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:17.859362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-577eb90c-96be-456d-b298-9a757c4a39ee tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:17.870829 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-577eb90c-96be-456d-b298-9a757c4a39ee tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:17.871505 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-577eb90c-96be-456d-b298-9a757c4a39ee tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:17.872518 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-577eb90c-96be-456d-b298-9a757c4a39ee tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:17.873086 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-577eb90c-96be-456d-b298-9a757c4a39ee tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:17.944490 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-577eb90c-96be-456d-b298-9a757c4a39ee tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:17.953291 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-577eb90c-96be-456d-b298-9a757c4a39ee tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.102104 May 26 16:58:17.964426 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 29/48] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:17 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:18.049738 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-03f43dc5-2b17-40a5-b413-f34864a35ab8 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:18.051852 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-03f43dc5-2b17-40a5-b413-f34864a35ab8 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:18.060132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03f43dc5-2b17-40a5-b413-f34864a35ab8 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:18.060589 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03f43dc5-2b17-40a5-b413-f34864a35ab8 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:18.061478 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03f43dc5-2b17-40a5-b413-f34864a35ab8 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:18.061914 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03f43dc5-2b17-40a5-b413-f34864a35ab8 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:18.092009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b9a87a42-8e81-4839-b64c-b81496d06d05 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:18.092601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b9a87a42-8e81-4839-b64c-b81496d06d05 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:18.099966 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b9a87a42-8e81-4839-b64c-b81496d06d05 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:18.100641 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b9a87a42-8e81-4839-b64c-b81496d06d05 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:18.102002 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b9a87a42-8e81-4839-b64c-b81496d06d05 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:18.103890 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b9a87a42-8e81-4839-b64c-b81496d06d05 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:18.212030 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b9a87a42-8e81-4839-b64c-b81496d06d05 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:18.220566 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b9a87a42-8e81-4839-b64c-b81496d06d05 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.135181 May 26 16:58:18.221346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 30/49] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:18 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:18.256077 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9daf3ad0-2ee1-440e-af87-fd5666336b5c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:18.259061 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9daf3ad0-2ee1-440e-af87-fd5666336b5c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:18.282765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9daf3ad0-2ee1-440e-af87-fd5666336b5c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:18.283273 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9daf3ad0-2ee1-440e-af87-fd5666336b5c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:18.284158 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9daf3ad0-2ee1-440e-af87-fd5666336b5c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:18.285785 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9daf3ad0-2ee1-440e-af87-fd5666336b5c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:18.361742 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-03f43dc5-2b17-40a5-b413-f34864a35ab8 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:18.392151 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-03f43dc5-2b17-40a5-b413-f34864a35ab8 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.336924 May 26 16:58:18.392151 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 20/50] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:18 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:18.392863 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9daf3ad0-2ee1-440e-af87-fd5666336b5c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:18.406280 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9daf3ad0-2ee1-440e-af87-fd5666336b5c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:18.409171 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9daf3ad0-2ee1-440e-af87-fd5666336b5c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:18.411103 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9daf3ad0-2ee1-440e-af87-fd5666336b5c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.166209 May 26 16:58:18.421668 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 31/51] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:18 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:18.974057 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-81f8b523-12cc-44d6-910a-03385cceb641 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:18.975151 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-81f8b523-12cc-44d6-910a-03385cceb641 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:18.982246 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-81f8b523-12cc-44d6-910a-03385cceb641 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:18.982731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-81f8b523-12cc-44d6-910a-03385cceb641 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:18.983658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-81f8b523-12cc-44d6-910a-03385cceb641 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:18.984162 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-81f8b523-12cc-44d6-910a-03385cceb641 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:19.054426 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-81f8b523-12cc-44d6-910a-03385cceb641 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:19.062223 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-81f8b523-12cc-44d6-910a-03385cceb641 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.093838 May 26 16:58:19.062829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 21/52] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:18 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:19.238304 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a24d2a0c-7098-41d4-a72d-90f93eeadf18 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:19.238814 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a24d2a0c-7098-41d4-a72d-90f93eeadf18 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:19.255532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a24d2a0c-7098-41d4-a72d-90f93eeadf18 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:19.255532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a24d2a0c-7098-41d4-a72d-90f93eeadf18 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:19.255532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a24d2a0c-7098-41d4-a72d-90f93eeadf18 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:19.255532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a24d2a0c-7098-41d4-a72d-90f93eeadf18 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:19.323984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a24d2a0c-7098-41d4-a72d-90f93eeadf18 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:19.334078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a24d2a0c-7098-41d4-a72d-90f93eeadf18 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.100785 May 26 16:58:19.335012 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 32/53] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:19 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:19.408735 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-27b5cfea-27b5-4354-afb7-2fd7b08feec0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:19.409947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-27b5cfea-27b5-4354-afb7-2fd7b08feec0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:19.417022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-27b5cfea-27b5-4354-afb7-2fd7b08feec0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:19.417476 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-27b5cfea-27b5-4354-afb7-2fd7b08feec0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:19.418487 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-27b5cfea-27b5-4354-afb7-2fd7b08feec0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:19.419214 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-27b5cfea-27b5-4354-afb7-2fd7b08feec0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:19.432809 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4e0a336d-60bf-42e3-98ef-d07ca4520a0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:19.433467 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4e0a336d-60bf-42e3-98ef-d07ca4520a0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:19.438027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:19.440672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4e0a336d-60bf-42e3-98ef-d07ca4520a0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:19.441210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4e0a336d-60bf-42e3-98ef-d07ca4520a0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:19.442283 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4e0a336d-60bf-42e3-98ef-d07ca4520a0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:19.442837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4e0a336d-60bf-42e3-98ef-d07ca4520a0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:19.530487 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4e0a336d-60bf-42e3-98ef-d07ca4520a0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:19.542411 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4e0a336d-60bf-42e3-98ef-d07ca4520a0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:19.544341 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4e0a336d-60bf-42e3-98ef-d07ca4520a0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:19.545552 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4e0a336d-60bf-42e3-98ef-d07ca4520a0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.117155 May 26 16:58:19.546833 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 33/54] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:19 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:19.657189 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-27b5cfea-27b5-4354-afb7-2fd7b08feec0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:19.669091 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-27b5cfea-27b5-4354-afb7-2fd7b08feec0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.264870 May 26 16:58:19.670067 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 22/55] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:19 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:20.081220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0f482f14-71b5-4ef8-8432-67a6b3abcd9f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:20.081841 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0f482f14-71b5-4ef8-8432-67a6b3abcd9f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:20.088040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0f482f14-71b5-4ef8-8432-67a6b3abcd9f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:20.088489 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0f482f14-71b5-4ef8-8432-67a6b3abcd9f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:20.089286 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0f482f14-71b5-4ef8-8432-67a6b3abcd9f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:20.089719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0f482f14-71b5-4ef8-8432-67a6b3abcd9f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:20.150574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0f482f14-71b5-4ef8-8432-67a6b3abcd9f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:20.161676 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0f482f14-71b5-4ef8-8432-67a6b3abcd9f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.085408 May 26 16:58:20.162889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 34/56] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:20 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:20.352738 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f92bb91a-93df-4b2c-b01f-9dfbbd15df9f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:20.353382 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f92bb91a-93df-4b2c-b01f-9dfbbd15df9f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:20.367125 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f92bb91a-93df-4b2c-b01f-9dfbbd15df9f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:20.367565 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f92bb91a-93df-4b2c-b01f-9dfbbd15df9f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:20.368314 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f92bb91a-93df-4b2c-b01f-9dfbbd15df9f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:20.368737 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f92bb91a-93df-4b2c-b01f-9dfbbd15df9f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:20.431249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f92bb91a-93df-4b2c-b01f-9dfbbd15df9f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:20.439365 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f92bb91a-93df-4b2c-b01f-9dfbbd15df9f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.090631 May 26 16:58:20.439935 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 23/57] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:20 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:20.567337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-76b3bf89-8f4e-4be0-a478-0974196ca7a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:20.567938 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-76b3bf89-8f4e-4be0-a478-0974196ca7a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:20.573940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-76b3bf89-8f4e-4be0-a478-0974196ca7a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:20.579932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-76b3bf89-8f4e-4be0-a478-0974196ca7a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:20.581077 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-76b3bf89-8f4e-4be0-a478-0974196ca7a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:20.581522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-76b3bf89-8f4e-4be0-a478-0974196ca7a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:20.646827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-76b3bf89-8f4e-4be0-a478-0974196ca7a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:20.659022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-76b3bf89-8f4e-4be0-a478-0974196ca7a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:20.660598 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-76b3bf89-8f4e-4be0-a478-0974196ca7a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:20.662035 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-76b3bf89-8f4e-4be0-a478-0974196ca7a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.098703 May 26 16:58:20.662692 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 35/58] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:20 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:20.687800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-37120bf6-38c3-4db3-8550-f3d902a2360e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:20.689112 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-37120bf6-38c3-4db3-8550-f3d902a2360e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:20.696370 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-37120bf6-38c3-4db3-8550-f3d902a2360e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:20.697317 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-37120bf6-38c3-4db3-8550-f3d902a2360e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:20.698265 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-37120bf6-38c3-4db3-8550-f3d902a2360e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:20.698748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-37120bf6-38c3-4db3-8550-f3d902a2360e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:20.839279 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-37120bf6-38c3-4db3-8550-f3d902a2360e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:20.849402 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-37120bf6-38c3-4db3-8550-f3d902a2360e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.165645 May 26 16:58:20.849994 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 24/59] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:20 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:21.179914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3e5eccea-a95c-4cd9-bcd8-e3a9efbed9d5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:21.180520 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3e5eccea-a95c-4cd9-bcd8-e3a9efbed9d5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:21.186700 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3e5eccea-a95c-4cd9-bcd8-e3a9efbed9d5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:21.187147 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3e5eccea-a95c-4cd9-bcd8-e3a9efbed9d5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:21.187978 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3e5eccea-a95c-4cd9-bcd8-e3a9efbed9d5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:21.189148 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3e5eccea-a95c-4cd9-bcd8-e3a9efbed9d5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:21.256228 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3e5eccea-a95c-4cd9-bcd8-e3a9efbed9d5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:21.263195 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3e5eccea-a95c-4cd9-bcd8-e3a9efbed9d5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.087210 May 26 16:58:21.263770 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 36/60] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:21 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:21.458080 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-152093ab-e91c-45fd-bcbf-70d7b4781a6b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:21.458793 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-152093ab-e91c-45fd-bcbf-70d7b4781a6b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:21.460861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=6 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:21.461606 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=32 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:21.466993 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-152093ab-e91c-45fd-bcbf-70d7b4781a6b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:21.467519 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-152093ab-e91c-45fd-bcbf-70d7b4781a6b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:21.468387 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-152093ab-e91c-45fd-bcbf-70d7b4781a6b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:21.468884 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-152093ab-e91c-45fd-bcbf-70d7b4781a6b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:21.539212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-152093ab-e91c-45fd-bcbf-70d7b4781a6b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:21.547075 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-152093ab-e91c-45fd-bcbf-70d7b4781a6b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.093603 May 26 16:58:21.547855 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 25/61] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:21 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:21.680522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b49323e6-74e7-4f78-b50a-ceaf830ee9e2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:21.681847 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b49323e6-74e7-4f78-b50a-ceaf830ee9e2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:21.693243 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:21.697387 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b49323e6-74e7-4f78-b50a-ceaf830ee9e2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:21.698237 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b49323e6-74e7-4f78-b50a-ceaf830ee9e2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:21.699204 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b49323e6-74e7-4f78-b50a-ceaf830ee9e2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:21.699662 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b49323e6-74e7-4f78-b50a-ceaf830ee9e2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:21.771237 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b49323e6-74e7-4f78-b50a-ceaf830ee9e2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:21.783246 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b49323e6-74e7-4f78-b50a-ceaf830ee9e2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:21.784764 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b49323e6-74e7-4f78-b50a-ceaf830ee9e2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:21.786315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b49323e6-74e7-4f78-b50a-ceaf830ee9e2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.109874 May 26 16:58:21.787043 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 37/62] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:21 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:21.868253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-733b3d20-45e4-4b06-9fb0-9839a3d743b2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:21.868948 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-733b3d20-45e4-4b06-9fb0-9839a3d743b2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:21.875546 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-733b3d20-45e4-4b06-9fb0-9839a3d743b2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:21.876757 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-733b3d20-45e4-4b06-9fb0-9839a3d743b2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:21.877600 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-733b3d20-45e4-4b06-9fb0-9839a3d743b2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:21.878107 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-733b3d20-45e4-4b06-9fb0-9839a3d743b2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.017686 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-733b3d20-45e4-4b06-9fb0-9839a3d743b2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:22.027049 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-733b3d20-45e4-4b06-9fb0-9839a3d743b2 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.163977 May 26 16:58:22.027789 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 26/63] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:21 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:22.280063 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a7df9c07-a9f0-4cf8-9572-ea20cc4b8750 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:22.280610 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a7df9c07-a9f0-4cf8-9572-ea20cc4b8750 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:22.287585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a7df9c07-a9f0-4cf8-9572-ea20cc4b8750 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.287995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a7df9c07-a9f0-4cf8-9572-ea20cc4b8750 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.288755 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a7df9c07-a9f0-4cf8-9572-ea20cc4b8750 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.289191 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a7df9c07-a9f0-4cf8-9572-ea20cc4b8750 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.349366 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a7df9c07-a9f0-4cf8-9572-ea20cc4b8750 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:22.356703 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a7df9c07-a9f0-4cf8-9572-ea20cc4b8750 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.080606 May 26 16:58:22.357267 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 38/64] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:22 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:22.564347 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e666066d-a3ba-456e-89be-cabc9851d47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:22.564952 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e666066d-a3ba-456e-89be-cabc9851d47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:22.570998 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e666066d-a3ba-456e-89be-cabc9851d47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.571471 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e666066d-a3ba-456e-89be-cabc9851d47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.577520 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e666066d-a3ba-456e-89be-cabc9851d47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.577520 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e666066d-a3ba-456e-89be-cabc9851d47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.635759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e666066d-a3ba-456e-89be-cabc9851d47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:22.644903 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e666066d-a3ba-456e-89be-cabc9851d47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.084066 May 26 16:58:22.645239 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 27/65] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:22 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:22.811387 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b725a214-6716-439b-8a73-f9d8dbe7e485 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:22.811932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b725a214-6716-439b-8a73-f9d8dbe7e485 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:22.815107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=20 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:22.822038 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b725a214-6716-439b-8a73-f9d8dbe7e485 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.822038 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b725a214-6716-439b-8a73-f9d8dbe7e485 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.822038 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b725a214-6716-439b-8a73-f9d8dbe7e485 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.822038 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b725a214-6716-439b-8a73-f9d8dbe7e485 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.886184 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b725a214-6716-439b-8a73-f9d8dbe7e485 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:22.895401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b725a214-6716-439b-8a73-f9d8dbe7e485 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:22.896909 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b725a214-6716-439b-8a73-f9d8dbe7e485 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:22.898006 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b725a214-6716-439b-8a73-f9d8dbe7e485 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.090592 May 26 16:58:22.898587 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 39/66] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:22 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:23.044714 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ebb2447d-3953-459d-b099-4d7454552dd5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:23.045351 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ebb2447d-3953-459d-b099-4d7454552dd5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:23.051519 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ebb2447d-3953-459d-b099-4d7454552dd5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:23.051962 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ebb2447d-3953-459d-b099-4d7454552dd5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:23.052718 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ebb2447d-3953-459d-b099-4d7454552dd5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:23.053147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ebb2447d-3953-459d-b099-4d7454552dd5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:23.184209 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ebb2447d-3953-459d-b099-4d7454552dd5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:23.192317 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ebb2447d-3953-459d-b099-4d7454552dd5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.151504 May 26 16:58:23.195606 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 28/67] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:23 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:23.374313 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0ba65f41-e3a5-48fc-b219-bec33509298b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:23.374933 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0ba65f41-e3a5-48fc-b219-bec33509298b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:23.382035 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0ba65f41-e3a5-48fc-b219-bec33509298b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:23.382567 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0ba65f41-e3a5-48fc-b219-bec33509298b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:23.383301 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0ba65f41-e3a5-48fc-b219-bec33509298b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:23.383732 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0ba65f41-e3a5-48fc-b219-bec33509298b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:23.446780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0ba65f41-e3a5-48fc-b219-bec33509298b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:23.454123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0ba65f41-e3a5-48fc-b219-bec33509298b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.083819 May 26 16:58:23.454710 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 40/68] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:23 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:23.661693 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ffb7dee8-2659-44fb-9a4f-755946b90b8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:23.662299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ffb7dee8-2659-44fb-9a4f-755946b90b8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:23.668865 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ffb7dee8-2659-44fb-9a4f-755946b90b8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:23.669306 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ffb7dee8-2659-44fb-9a4f-755946b90b8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:23.670059 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ffb7dee8-2659-44fb-9a4f-755946b90b8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:23.670532 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ffb7dee8-2659-44fb-9a4f-755946b90b8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:23.731515 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ffb7dee8-2659-44fb-9a4f-755946b90b8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:23.739525 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ffb7dee8-2659-44fb-9a4f-755946b90b8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.082556 May 26 16:58:23.740095 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 29/69] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:23 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:23.916847 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e0e471e9-8e7b-40ad-b960-40859d4656c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:23.917501 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e0e471e9-8e7b-40ad-b960-40859d4656c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:23.923719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e0e471e9-8e7b-40ad-b960-40859d4656c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:23.924169 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e0e471e9-8e7b-40ad-b960-40859d4656c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:23.924936 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e0e471e9-8e7b-40ad-b960-40859d4656c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:23.925372 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e0e471e9-8e7b-40ad-b960-40859d4656c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:23.984948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e0e471e9-8e7b-40ad-b960-40859d4656c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:23.992950 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e0e471e9-8e7b-40ad-b960-40859d4656c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:23.994494 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e0e471e9-8e7b-40ad-b960-40859d4656c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:23.995581 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e0e471e9-8e7b-40ad-b960-40859d4656c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.083494 May 26 16:58:23.996136 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 41/70] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:23 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:24.209207 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a9c9a700-2411-4669-8a9b-0a7e384e296f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:24.210132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a9c9a700-2411-4669-8a9b-0a7e384e296f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:24.216207 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a9c9a700-2411-4669-8a9b-0a7e384e296f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:24.216649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a9c9a700-2411-4669-8a9b-0a7e384e296f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:24.217399 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a9c9a700-2411-4669-8a9b-0a7e384e296f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:24.217822 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a9c9a700-2411-4669-8a9b-0a7e384e296f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:24.349333 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a9c9a700-2411-4669-8a9b-0a7e384e296f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:24.356788 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a9c9a700-2411-4669-8a9b-0a7e384e296f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.152085 May 26 16:58:24.357353 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 30/71] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:24 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:24.472077 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2325604b-4f72-453f-be8e-de26afefc595 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:24.472631 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2325604b-4f72-453f-be8e-de26afefc595 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:24.478855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2325604b-4f72-453f-be8e-de26afefc595 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:24.479302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2325604b-4f72-453f-be8e-de26afefc595 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:24.480073 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2325604b-4f72-453f-be8e-de26afefc595 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:24.480510 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2325604b-4f72-453f-be8e-de26afefc595 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:24.548923 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2325604b-4f72-453f-be8e-de26afefc595 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:24.557121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2325604b-4f72-453f-be8e-de26afefc595 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.089654 May 26 16:58:24.557700 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 42/72] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:24 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:24.756729 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ad52b079-a0a8-42b5-971d-2607606dbb12 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:24.757418 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ad52b079-a0a8-42b5-971d-2607606dbb12 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:24.763616 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ad52b079-a0a8-42b5-971d-2607606dbb12 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:24.764061 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ad52b079-a0a8-42b5-971d-2607606dbb12 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:24.765078 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ad52b079-a0a8-42b5-971d-2607606dbb12 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:24.765709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ad52b079-a0a8-42b5-971d-2607606dbb12 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:24.829448 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ad52b079-a0a8-42b5-971d-2607606dbb12 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:24.839056 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ad52b079-a0a8-42b5-971d-2607606dbb12 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.086226 May 26 16:58:24.842307 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 31/73] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:24 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:25.019439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ab9cb4fa-631d-44a6-b366-55b391be00aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:25.019984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ab9cb4fa-631d-44a6-b366-55b391be00aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:25.026425 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ab9cb4fa-631d-44a6-b366-55b391be00aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:25.026877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ab9cb4fa-631d-44a6-b366-55b391be00aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:25.027660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ab9cb4fa-631d-44a6-b366-55b391be00aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:25.028095 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ab9cb4fa-631d-44a6-b366-55b391be00aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:25.033108 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:25.096675 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ab9cb4fa-631d-44a6-b366-55b391be00aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:25.104973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ab9cb4fa-631d-44a6-b366-55b391be00aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:25.106538 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ab9cb4fa-631d-44a6-b366-55b391be00aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:25.107822 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ab9cb4fa-631d-44a6-b366-55b391be00aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.093196 May 26 16:58:25.108382 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 43/74] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:25 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:25.374113 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-148c9a84-b0f0-4a96-8d23-06178a20e977 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:25.374669 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-148c9a84-b0f0-4a96-8d23-06178a20e977 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:25.380826 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-148c9a84-b0f0-4a96-8d23-06178a20e977 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:25.381273 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-148c9a84-b0f0-4a96-8d23-06178a20e977 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:25.382032 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-148c9a84-b0f0-4a96-8d23-06178a20e977 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:25.382508 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-148c9a84-b0f0-4a96-8d23-06178a20e977 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:25.509431 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-148c9a84-b0f0-4a96-8d23-06178a20e977 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:25.517938 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-148c9a84-b0f0-4a96-8d23-06178a20e977 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.147744 May 26 16:58:25.518856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 32/75] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:25 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:25.575354 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-655f3db4-eefc-4aed-94c8-11f8b84d213c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:25.575958 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-655f3db4-eefc-4aed-94c8-11f8b84d213c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:25.583316 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-655f3db4-eefc-4aed-94c8-11f8b84d213c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:25.583765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-655f3db4-eefc-4aed-94c8-11f8b84d213c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:25.584524 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-655f3db4-eefc-4aed-94c8-11f8b84d213c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:25.584957 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-655f3db4-eefc-4aed-94c8-11f8b84d213c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:25.646210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-655f3db4-eefc-4aed-94c8-11f8b84d213c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:25.653574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-655f3db4-eefc-4aed-94c8-11f8b84d213c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.081970 May 26 16:58:25.654141 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 44/76] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:25 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:25.857393 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-00674649-bfd8-43af-b0ae-e1f2bce05063 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:25.857990 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-00674649-bfd8-43af-b0ae-e1f2bce05063 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:25.864212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-00674649-bfd8-43af-b0ae-e1f2bce05063 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:25.864661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-00674649-bfd8-43af-b0ae-e1f2bce05063 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:25.865417 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-00674649-bfd8-43af-b0ae-e1f2bce05063 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:25.865851 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-00674649-bfd8-43af-b0ae-e1f2bce05063 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:25.928973 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-00674649-bfd8-43af-b0ae-e1f2bce05063 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:25.939541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-00674649-bfd8-43af-b0ae-e1f2bce05063 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.085901 May 26 16:58:25.940726 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 33/77] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:25 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:26.127329 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bac1612d-76ab-45c8-a443-d96d7ac7f8f5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:26.127935 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bac1612d-76ab-45c8-a443-d96d7ac7f8f5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:26.133910 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bac1612d-76ab-45c8-a443-d96d7ac7f8f5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.134380 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bac1612d-76ab-45c8-a443-d96d7ac7f8f5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:26.135128 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bac1612d-76ab-45c8-a443-d96d7ac7f8f5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.135557 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bac1612d-76ab-45c8-a443-d96d7ac7f8f5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:26.193878 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bac1612d-76ab-45c8-a443-d96d7ac7f8f5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:26.202133 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bac1612d-76ab-45c8-a443-d96d7ac7f8f5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:26.203700 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bac1612d-76ab-45c8-a443-d96d7ac7f8f5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:26.204976 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bac1612d-76ab-45c8-a443-d96d7ac7f8f5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.082311 May 26 16:58:26.205815 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 45/78] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:26 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:26.536111 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c428dfbb-850e-49ae-8830-6eb1a7f38e48 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:26.536663 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c428dfbb-850e-49ae-8830-6eb1a7f38e48 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:26.542791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c428dfbb-850e-49ae-8830-6eb1a7f38e48 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.543241 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c428dfbb-850e-49ae-8830-6eb1a7f38e48 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:26.543998 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c428dfbb-850e-49ae-8830-6eb1a7f38e48 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.544428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c428dfbb-850e-49ae-8830-6eb1a7f38e48 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:26.671161 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-75f0652c-4235-4901-94b7-48ac5bf4fb68 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:26.671767 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-75f0652c-4235-4901-94b7-48ac5bf4fb68 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:26.679316 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-75f0652c-4235-4901-94b7-48ac5bf4fb68 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.679765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-75f0652c-4235-4901-94b7-48ac5bf4fb68 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:26.680535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-75f0652c-4235-4901-94b7-48ac5bf4fb68 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.680963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-75f0652c-4235-4901-94b7-48ac5bf4fb68 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:26.706513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c428dfbb-850e-49ae-8830-6eb1a7f38e48 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:26.714428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c428dfbb-850e-49ae-8830-6eb1a7f38e48 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.183420 May 26 16:58:26.725337 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 34/79] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:26 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:26.766865 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-75f0652c-4235-4901-94b7-48ac5bf4fb68 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:26.775588 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-75f0652c-4235-4901-94b7-48ac5bf4fb68 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.108299 May 26 16:58:26.776866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 46/80] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:26 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:26.958028 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-bf9c5e38-a48a-4dc1-ac49-93b8a8a1501e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:26.958703 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-bf9c5e38-a48a-4dc1-ac49-93b8a8a1501e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:26.965000 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bf9c5e38-a48a-4dc1-ac49-93b8a8a1501e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.965514 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bf9c5e38-a48a-4dc1-ac49-93b8a8a1501e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:26.966394 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bf9c5e38-a48a-4dc1-ac49-93b8a8a1501e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.967027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bf9c5e38-a48a-4dc1-ac49-93b8a8a1501e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:27.034587 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bf9c5e38-a48a-4dc1-ac49-93b8a8a1501e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:27.046402 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-bf9c5e38-a48a-4dc1-ac49-93b8a8a1501e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.093035 May 26 16:58:27.048051 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 35/81] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:26 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:27.224413 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-08720ddf-66be-4781-b996-695cde427f40 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:27.225090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-08720ddf-66be-4781-b996-695cde427f40 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:27.231826 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-08720ddf-66be-4781-b996-695cde427f40 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:27.232281 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-08720ddf-66be-4781-b996-695cde427f40 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:27.233082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-08720ddf-66be-4781-b996-695cde427f40 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:27.233514 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-08720ddf-66be-4781-b996-695cde427f40 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:27.295430 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-08720ddf-66be-4781-b996-695cde427f40 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:27.304129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-08720ddf-66be-4781-b996-695cde427f40 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:27.305632 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-08720ddf-66be-4781-b996-695cde427f40 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:27.306753 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-08720ddf-66be-4781-b996-695cde427f40 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.086423 May 26 16:58:27.307314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 47/82] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:27 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:27.732314 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-05b418da-a28c-48d5-b527-04e0a655967b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:27.732918 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-05b418da-a28c-48d5-b527-04e0a655967b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:27.739019 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-05b418da-a28c-48d5-b527-04e0a655967b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:27.739468 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-05b418da-a28c-48d5-b527-04e0a655967b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:27.740234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-05b418da-a28c-48d5-b527-04e0a655967b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:27.740670 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-05b418da-a28c-48d5-b527-04e0a655967b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:27.794043 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6f838047-485a-44cf-83ef-b77d8ac783fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:27.794769 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6f838047-485a-44cf-83ef-b77d8ac783fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:27.800994 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6f838047-485a-44cf-83ef-b77d8ac783fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:27.801443 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6f838047-485a-44cf-83ef-b77d8ac783fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:27.802210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6f838047-485a-44cf-83ef-b77d8ac783fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:27.802667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6f838047-485a-44cf-83ef-b77d8ac783fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:27.876126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-05b418da-a28c-48d5-b527-04e0a655967b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:27.879258 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6f838047-485a-44cf-83ef-b77d8ac783fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:27.883707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-05b418da-a28c-48d5-b527-04e0a655967b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.155209 May 26 16:58:27.884467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 36/83] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:27 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:27.886408 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6f838047-485a-44cf-83ef-b77d8ac783fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.096183 May 26 16:58:27.886963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 48/84] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:27 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:28.065088 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-714d0f68-b053-4281-9331-70e06de712b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:28.065693 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-714d0f68-b053-4281-9331-70e06de712b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:28.071592 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-714d0f68-b053-4281-9331-70e06de712b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:28.072024 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-714d0f68-b053-4281-9331-70e06de712b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:28.072772 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-714d0f68-b053-4281-9331-70e06de712b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:28.073193 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-714d0f68-b053-4281-9331-70e06de712b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:28.135115 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-714d0f68-b053-4281-9331-70e06de712b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:28.143897 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-714d0f68-b053-4281-9331-70e06de712b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.083357 May 26 16:58:28.144476 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 37/85] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:28 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:28.324664 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9b1cc540-171e-4443-ad25-a22652b3c80c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:28.325260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9b1cc540-171e-4443-ad25-a22652b3c80c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:28.332276 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9b1cc540-171e-4443-ad25-a22652b3c80c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:28.332716 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9b1cc540-171e-4443-ad25-a22652b3c80c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:28.333465 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9b1cc540-171e-4443-ad25-a22652b3c80c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:28.333889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9b1cc540-171e-4443-ad25-a22652b3c80c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:28.394786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9b1cc540-171e-4443-ad25-a22652b3c80c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:28.402808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9b1cc540-171e-4443-ad25-a22652b3c80c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:28.404309 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9b1cc540-171e-4443-ad25-a22652b3c80c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:28.405396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9b1cc540-171e-4443-ad25-a22652b3c80c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.084817 May 26 16:58:28.406000 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 49/86] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:28 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:28.900960 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fc4b8d6b-2627-4cfa-9288-9ebbaf50905c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:28.901563 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fc4b8d6b-2627-4cfa-9288-9ebbaf50905c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:28.903824 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3f048e23-f18c-4fbc-9f55-8e446350e9bf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:28.904438 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3f048e23-f18c-4fbc-9f55-8e446350e9bf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:28.909720 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d6b-2627-4cfa-9288-9ebbaf50905c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:28.910172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d6b-2627-4cfa-9288-9ebbaf50905c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:28.910860 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f048e23-f18c-4fbc-9f55-8e446350e9bf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:28.911003 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d6b-2627-4cfa-9288-9ebbaf50905c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:28.911319 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f048e23-f18c-4fbc-9f55-8e446350e9bf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:28.911435 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d6b-2627-4cfa-9288-9ebbaf50905c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:28.912107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f048e23-f18c-4fbc-9f55-8e446350e9bf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:28.912543 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f048e23-f18c-4fbc-9f55-8e446350e9bf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:28.975590 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3f048e23-f18c-4fbc-9f55-8e446350e9bf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:28.984056 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3f048e23-f18c-4fbc-9f55-8e446350e9bf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.083617 May 26 16:58:28.984657 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 50/87] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:28 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:29.049851 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fc4b8d6b-2627-4cfa-9288-9ebbaf50905c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:29.053498 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:29.057832 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fc4b8d6b-2627-4cfa-9288-9ebbaf50905c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.160783 May 26 16:58:29.062486 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 38/88] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:28 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:29.162583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e8d98f65-8515-437c-94b4-42fd44ea6cf8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:29.163121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e8d98f65-8515-437c-94b4-42fd44ea6cf8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:29.171068 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8d98f65-8515-437c-94b4-42fd44ea6cf8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:29.171068 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8d98f65-8515-437c-94b4-42fd44ea6cf8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:29.171068 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8d98f65-8515-437c-94b4-42fd44ea6cf8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:29.171068 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8d98f65-8515-437c-94b4-42fd44ea6cf8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:29.249721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e8d98f65-8515-437c-94b4-42fd44ea6cf8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:29.257371 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e8d98f65-8515-437c-94b4-42fd44ea6cf8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.099391 May 26 16:58:29.264917 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 51/89] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:29 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:29.423571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8892957f-f440-4610-bcb1-3a64502e0e8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:29.424082 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8892957f-f440-4610-bcb1-3a64502e0e8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:29.430410 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8892957f-f440-4610-bcb1-3a64502e0e8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:29.430855 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8892957f-f440-4610-bcb1-3a64502e0e8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:29.431628 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8892957f-f440-4610-bcb1-3a64502e0e8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:29.432044 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8892957f-f440-4610-bcb1-3a64502e0e8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:29.495357 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8892957f-f440-4610-bcb1-3a64502e0e8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:29.504035 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8892957f-f440-4610-bcb1-3a64502e0e8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:29.505581 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8892957f-f440-4610-bcb1-3a64502e0e8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:29.506645 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8892957f-f440-4610-bcb1-3a64502e0e8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1290 microversion: 2.20 time: 0.087122 May 26 16:58:29.507212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 39/90] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:29 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:30.001645 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b65f5bf0-383d-4a9f-b2ad-96dd7224b6be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:30.002522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b65f5bf0-383d-4a9f-b2ad-96dd7224b6be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:30.009000 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b65f5bf0-383d-4a9f-b2ad-96dd7224b6be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.009575 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b65f5bf0-383d-4a9f-b2ad-96dd7224b6be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.010478 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b65f5bf0-383d-4a9f-b2ad-96dd7224b6be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.010956 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b65f5bf0-383d-4a9f-b2ad-96dd7224b6be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.075876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-bbf40981-cee3-46cb-82c4-e76418f72bf5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:30.076496 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-bbf40981-cee3-46cb-82c4-e76418f72bf5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:30.078485 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b65f5bf0-383d-4a9f-b2ad-96dd7224b6be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:30.086653 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b65f5bf0-383d-4a9f-b2ad-96dd7224b6be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1245 microversion: 2.1 time: 0.089460 May 26 16:58:30.087961 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 52/91] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:29 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:30.090798 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bbf40981-cee3-46cb-82c4-e76418f72bf5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.091251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bbf40981-cee3-46cb-82c4-e76418f72bf5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.092038 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bbf40981-cee3-46cb-82c4-e76418f72bf5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.092558 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bbf40981-cee3-46cb-82c4-e76418f72bf5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.247739 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bbf40981-cee3-46cb-82c4-e76418f72bf5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:30.266868 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-bbf40981-cee3-46cb-82c4-e76418f72bf5 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.194951 May 26 16:58:30.269718 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 40/92] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:30 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:30.290918 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-09790a70-c40f-43bf-b058-e3c12bf538de tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:30.291804 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-09790a70-c40f-43bf-b058-e3c12bf538de tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:30.311681 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-09790a70-c40f-43bf-b058-e3c12bf538de tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.313122 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-09790a70-c40f-43bf-b058-e3c12bf538de tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.314417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-09790a70-c40f-43bf-b058-e3c12bf538de tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.315071 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-09790a70-c40f-43bf-b058-e3c12bf538de tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.401519 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-09790a70-c40f-43bf-b058-e3c12bf538de tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:30.409189 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-09790a70-c40f-43bf-b058-e3c12bf538de tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1305 microversion: 2.1 time: 0.133065 May 26 16:58:30.409761 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 53/93] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:30 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1305 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:30.528454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a6367a23-d475-4e9b-b381-1522f6283250 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:30.529077 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a6367a23-d475-4e9b-b381-1522f6283250 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:30.535593 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a6367a23-d475-4e9b-b381-1522f6283250 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.536048 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a6367a23-d475-4e9b-b381-1522f6283250 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.536846 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a6367a23-d475-4e9b-b381-1522f6283250 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.537296 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a6367a23-d475-4e9b-b381-1522f6283250 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.625160 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a6367a23-d475-4e9b-b381-1522f6283250 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:30.634761 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a6367a23-d475-4e9b-b381-1522f6283250 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:30.636274 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a6367a23-d475-4e9b-b381-1522f6283250 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:30.637559 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a6367a23-d475-4e9b-b381-1522f6283250 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1282 microversion: 2.20 time: 0.116528 May 26 16:58:30.648646 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 41/94] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:30 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1282 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:31.103781 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b982d649-2e36-4ceb-985d-8a3a60d52580 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:31.105056 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b982d649-2e36-4ceb-985d-8a3a60d52580 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:31.113685 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b982d649-2e36-4ceb-985d-8a3a60d52580 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.115885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b982d649-2e36-4ceb-985d-8a3a60d52580 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.115885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b982d649-2e36-4ceb-985d-8a3a60d52580 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.115885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b982d649-2e36-4ceb-985d-8a3a60d52580 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.185405 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b982d649-2e36-4ceb-985d-8a3a60d52580 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:31.198484 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b982d649-2e36-4ceb-985d-8a3a60d52580 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1293 microversion: 2.1 time: 0.098556 May 26 16:58:31.199240 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 54/95] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:31 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:31.287331 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5ca3388b-24b6-4a6c-963d-309da5a0db5a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:31.287831 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5ca3388b-24b6-4a6c-963d-309da5a0db5a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:31.298376 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5ca3388b-24b6-4a6c-963d-309da5a0db5a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.299151 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5ca3388b-24b6-4a6c-963d-309da5a0db5a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.300128 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5ca3388b-24b6-4a6c-963d-309da5a0db5a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.300755 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5ca3388b-24b6-4a6c-963d-309da5a0db5a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.427930 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ee880235-39c2-4b58-881d-bf7034deda56 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:31.428788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ee880235-39c2-4b58-881d-bf7034deda56 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:31.435187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee880235-39c2-4b58-881d-bf7034deda56 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.435781 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee880235-39c2-4b58-881d-bf7034deda56 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.436662 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee880235-39c2-4b58-881d-bf7034deda56 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.437198 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee880235-39c2-4b58-881d-bf7034deda56 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.519736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ee880235-39c2-4b58-881d-bf7034deda56 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:31.528242 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ee880235-39c2-4b58-881d-bf7034deda56 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1303 microversion: 2.1 time: 0.106137 May 26 16:58:31.528825 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 55/96] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:31 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:31.657627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-82b4c29d-5832-4d61-95b0-47a9f5f0d62c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:31.658388 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-82b4c29d-5832-4d61-95b0-47a9f5f0d62c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:31.669135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-82b4c29d-5832-4d61-95b0-47a9f5f0d62c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.669599 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-82b4c29d-5832-4d61-95b0-47a9f5f0d62c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.670409 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-82b4c29d-5832-4d61-95b0-47a9f5f0d62c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.670839 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-82b4c29d-5832-4d61-95b0-47a9f5f0d62c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.780305 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-82b4c29d-5832-4d61-95b0-47a9f5f0d62c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:31.790474 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5ca3388b-24b6-4a6c-963d-309da5a0db5a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:31.791413 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-82b4c29d-5832-4d61-95b0-47a9f5f0d62c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:31.793381 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-82b4c29d-5832-4d61-95b0-47a9f5f0d62c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:31.795157 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-82b4c29d-5832-4d61-95b0-47a9f5f0d62c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1338 microversion: 2.20 time: 0.142173 May 26 16:58:31.805900 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 56/97] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:31 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1338 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:58:31.815187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5ca3388b-24b6-4a6c-963d-309da5a0db5a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.533216 May 26 16:58:31.817785 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 42/98] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:31 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:32.217469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4e2295d7-8904-4b3a-af0a-8306bd25edd3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:32.218743 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4e2295d7-8904-4b3a-af0a-8306bd25edd3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:32.237809 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4e2295d7-8904-4b3a-af0a-8306bd25edd3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.242897 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4e2295d7-8904-4b3a-af0a-8306bd25edd3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.242897 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4e2295d7-8904-4b3a-af0a-8306bd25edd3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.242897 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4e2295d7-8904-4b3a-af0a-8306bd25edd3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.323104 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4e2295d7-8904-4b3a-af0a-8306bd25edd3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:32.335857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4e2295d7-8904-4b3a-af0a-8306bd25edd3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1293 microversion: 2.1 time: 0.122618 May 26 16:58:32.336524 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 57/99] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:32 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1293 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:32.557288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f658b197-d0dd-469f-9428-f181d5b75035 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:32.561001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f658b197-d0dd-469f-9428-f181d5b75035 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:32.583401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f658b197-d0dd-469f-9428-f181d5b75035 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.587229 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f658b197-d0dd-469f-9428-f181d5b75035 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.588295 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f658b197-d0dd-469f-9428-f181d5b75035 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.592689 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f658b197-d0dd-469f-9428-f181d5b75035 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.630694 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-1fa6ca99-94d2-4937-8b64-d2a319232b2a req-7c2f45cc-3398-45a7-9f31-46bab84c4bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27dd101-6b39-40a7-afa5-858040384fcd", "tag": "893bcd7a-23df-431b-9d0c-3ea69a22cbb2"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:32.652809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-1fa6ca99-94d2-4937-8b64-d2a319232b2a req-7c2f45cc-3398-45a7-9f31-46bab84c4bce service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.663230 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-1fa6ca99-94d2-4937-8b64-d2a319232b2a req-7c2f45cc-3398-45a7-9f31-46bab84c4bce service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.720397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-1fa6ca99-94d2-4937-8b64-d2a319232b2a req-7c2f45cc-3398-45a7-9f31-46bab84c4bce service nova] Creating event network-changed:893bcd7a-23df-431b-9d0c-3ea69a22cbb2 for instance b27dd101-6b39-40a7-afa5-858040384fcd on hv-cinder-83607 May 26 16:58:32.722640 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-1fa6ca99-94d2-4937-8b64-d2a319232b2a req-7c2f45cc-3398-45a7-9f31-46bab84c4bce service nova] Acquired lock "compute-rpcapi-router" {{(pid=130525) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 16:58:32.724089 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6afc0123-8316-4bc8-8bc9-96742e051ca6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.724791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6afc0123-8316-4bc8-8bc9-96742e051ca6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.725802 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6afc0123-8316-4bc8-8bc9-96742e051ca6 None None] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.726485 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6afc0123-8316-4bc8-8bc9-96742e051ca6 None None] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.739277 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.compute.rpcapi [None req-6afc0123-8316-4bc8-8bc9-96742e051ca6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 16:58:32.740423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6afc0123-8316-4bc8-8bc9-96742e051ca6 None None] Releasing lock "compute-rpcapi-router" {{(pid=130525) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 16:58:32.763879 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6afc0123-8316-4bc8-8bc9-96742e051ca6 None None] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295193 May 26 16:58:32.764797 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 43/100] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:32.825903 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a8edacd8-0c34-4b4d-88f0-b52ffdda7662 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:32.832561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a8edacd8-0c34-4b4d-88f0-b52ffdda7662 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:32.851966 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a8edacd8-0c34-4b4d-88f0-b52ffdda7662 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.869659 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a8edacd8-0c34-4b4d-88f0-b52ffdda7662 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.874231 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a8edacd8-0c34-4b4d-88f0-b52ffdda7662 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.874723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a8edacd8-0c34-4b4d-88f0-b52ffdda7662 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.994728 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a8edacd8-0c34-4b4d-88f0-b52ffdda7662 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:33.026830 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a8edacd8-0c34-4b4d-88f0-b52ffdda7662 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:33.029496 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a8edacd8-0c34-4b4d-88f0-b52ffdda7662 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:33.035374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a8edacd8-0c34-4b4d-88f0-b52ffdda7662 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1346 microversion: 2.20 time: 0.225854 May 26 16:58:33.046423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 44/101] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:32 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1346 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:33.051515 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-127b8d1d-93ee-494e-988b-efde9d9674cf tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:33.052137 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-127b8d1d-93ee-494e-988b-efde9d9674cf tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:33.061322 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-127b8d1d-93ee-494e-988b-efde9d9674cf tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:33.063242 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-127b8d1d-93ee-494e-988b-efde9d9674cf tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:33.064256 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-127b8d1d-93ee-494e-988b-efde9d9674cf tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:33.067062 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-127b8d1d-93ee-494e-988b-efde9d9674cf tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:33.082125 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f658b197-d0dd-469f-9428-f181d5b75035 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:33.089898 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f658b197-d0dd-469f-9428-f181d5b75035 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.547503 May 26 16:58:33.090705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 58/102] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:32 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:33.362101 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-48f58caa-ee2a-404d-9fd8-7cb3fbb41248 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:33.363214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-48f58caa-ee2a-404d-9fd8-7cb3fbb41248 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:33.372897 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48f58caa-ee2a-404d-9fd8-7cb3fbb41248 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:33.373916 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48f58caa-ee2a-404d-9fd8-7cb3fbb41248 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:33.374945 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48f58caa-ee2a-404d-9fd8-7cb3fbb41248 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:33.376973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48f58caa-ee2a-404d-9fd8-7cb3fbb41248 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:33.436699 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-127b8d1d-93ee-494e-988b-efde9d9674cf tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:33.548101 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-127b8d1d-93ee-494e-988b-efde9d9674cf tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.400043 May 26 16:58:33.548101 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 45/103] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:33 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:33.549866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-48f58caa-ee2a-404d-9fd8-7cb3fbb41248 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:33.549866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:33.549866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-48f58caa-ee2a-404d-9fd8-7cb3fbb41248 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1299 microversion: 2.1 time: 0.193233 May 26 16:58:33.549866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 59/104] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:33 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1299 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:34.053808 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5bd669ce-8c93-4d9a-a735-49bc4de37cf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:34.054722 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5bd669ce-8c93-4d9a-a735-49bc4de37cf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:34.062308 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5bd669ce-8c93-4d9a-a735-49bc4de37cf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.062985 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5bd669ce-8c93-4d9a-a735-49bc4de37cf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.064067 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5bd669ce-8c93-4d9a-a735-49bc4de37cf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.064501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5bd669ce-8c93-4d9a-a735-49bc4de37cf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.108034 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2e7861fb-e29a-42aa-8323-8cff9dbceef3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:34.108889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2e7861fb-e29a-42aa-8323-8cff9dbceef3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:34.115681 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2e7861fb-e29a-42aa-8323-8cff9dbceef3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.116125 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2e7861fb-e29a-42aa-8323-8cff9dbceef3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.116888 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2e7861fb-e29a-42aa-8323-8cff9dbceef3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.117317 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2e7861fb-e29a-42aa-8323-8cff9dbceef3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.137502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5bd669ce-8c93-4d9a-a735-49bc4de37cf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:34.145623 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5bd669ce-8c93-4d9a-a735-49bc4de37cf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:34.147237 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5bd669ce-8c93-4d9a-a735-49bc4de37cf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:34.148407 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5bd669ce-8c93-4d9a-a735-49bc4de37cf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1356 microversion: 2.20 time: 0.098748 May 26 16:58:34.149111 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 46/105] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:34 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:34.263213 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2e7861fb-e29a-42aa-8323-8cff9dbceef3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:34.270655 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2e7861fb-e29a-42aa-8323-8cff9dbceef3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.166693 May 26 16:58:34.271236 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 60/106] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:34 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:34.521586 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fb8488a1-c686-473a-8879-3f42eb7b864a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:34.525509 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fb8488a1-c686-473a-8879-3f42eb7b864a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:34.542889 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fb8488a1-c686-473a-8879-3f42eb7b864a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.543536 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fb8488a1-c686-473a-8879-3f42eb7b864a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.548777 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fb8488a1-c686-473a-8879-3f42eb7b864a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.549476 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fb8488a1-c686-473a-8879-3f42eb7b864a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.560352 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7f7ed50e-3ae4-4fef-8f51-19cd460b0fc2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:34.560957 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7f7ed50e-3ae4-4fef-8f51-19cd460b0fc2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:34.575216 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f7ed50e-3ae4-4fef-8f51-19cd460b0fc2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.575830 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f7ed50e-3ae4-4fef-8f51-19cd460b0fc2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.578180 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f7ed50e-3ae4-4fef-8f51-19cd460b0fc2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.580319 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f7ed50e-3ae4-4fef-8f51-19cd460b0fc2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.745435 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7f7ed50e-3ae4-4fef-8f51-19cd460b0fc2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:34.754059 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7f7ed50e-3ae4-4fef-8f51-19cd460b0fc2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1299 microversion: 2.1 time: 0.197678 May 26 16:58:34.766152 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 61/107] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:34 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1299 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:34.848193 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-24c43b5c-1cd4-41ed-bc30-ea8a88a45da2 req-01da0bac-360b-47b1-b46d-4ef5b64cdebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60352cdb-28fe-49a5-85e8-ae2c9c92b184", "tag": "7f96d44e-35cb-48aa-a514-fdf4fed75c08"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:34.875089 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-24c43b5c-1cd4-41ed-bc30-ea8a88a45da2 req-01da0bac-360b-47b1-b46d-4ef5b64cdebc service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.876855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-24c43b5c-1cd4-41ed-bc30-ea8a88a45da2 req-01da0bac-360b-47b1-b46d-4ef5b64cdebc service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.904299 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-24c43b5c-1cd4-41ed-bc30-ea8a88a45da2 req-01da0bac-360b-47b1-b46d-4ef5b64cdebc service nova] Creating event network-changed:7f96d44e-35cb-48aa-a514-fdf4fed75c08 for instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 on hv-cinder-83607 May 26 16:58:34.905098 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-24c43b5c-1cd4-41ed-bc30-ea8a88a45da2 req-01da0bac-360b-47b1-b46d-4ef5b64cdebc service nova] Acquired lock "compute-rpcapi-router" {{(pid=130526) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 16:58:34.907428 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f44bbd9d-ceb7-406f-bdad-e5162dfb8cee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.908371 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f44bbd9d-ceb7-406f-bdad-e5162dfb8cee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.909375 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f44bbd9d-ceb7-406f-bdad-e5162dfb8cee None None] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.909986 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f44bbd9d-ceb7-406f-bdad-e5162dfb8cee None None] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.921526 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.compute.rpcapi [None req-f44bbd9d-ceb7-406f-bdad-e5162dfb8cee None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 16:58:34.922800 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f44bbd9d-ceb7-406f-bdad-e5162dfb8cee None None] Releasing lock "compute-rpcapi-router" {{(pid=130526) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 16:58:34.975686 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f44bbd9d-ceb7-406f-bdad-e5162dfb8cee None None] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133927 May 26 16:58:34.977909 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 62/108] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:58:34.989205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fb8488a1-c686-473a-8879-3f42eb7b864a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:34.996814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fb8488a1-c686-473a-8879-3f42eb7b864a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.480320 May 26 16:58:35.007304 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 47/109] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:34 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:35.168438 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-af16a2e4-bf67-4afc-8ebe-7be06e59f491 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:35.169339 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-af16a2e4-bf67-4afc-8ebe-7be06e59f491 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:35.177484 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-af16a2e4-bf67-4afc-8ebe-7be06e59f491 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:35.178084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-af16a2e4-bf67-4afc-8ebe-7be06e59f491 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:35.178869 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-af16a2e4-bf67-4afc-8ebe-7be06e59f491 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:35.179532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-af16a2e4-bf67-4afc-8ebe-7be06e59f491 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:35.288537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-03806b50-96d4-4378-95d8-200857ed8df9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:35.290009 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-03806b50-96d4-4378-95d8-200857ed8df9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:35.304887 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03806b50-96d4-4378-95d8-200857ed8df9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:35.309494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03806b50-96d4-4378-95d8-200857ed8df9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:35.309494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03806b50-96d4-4378-95d8-200857ed8df9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:35.309494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03806b50-96d4-4378-95d8-200857ed8df9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:35.483577 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-af16a2e4-bf67-4afc-8ebe-7be06e59f491 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:35.493788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-af16a2e4-bf67-4afc-8ebe-7be06e59f491 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:35.495891 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-af16a2e4-bf67-4afc-8ebe-7be06e59f491 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:35.497026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-af16a2e4-bf67-4afc-8ebe-7be06e59f491 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.334207 May 26 16:58:35.497829 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 63/110] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:35 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:35.568832 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-03806b50-96d4-4378-95d8-200857ed8df9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:35.580045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-03806b50-96d4-4378-95d8-200857ed8df9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.292835 May 26 16:58:35.588613 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 48/111] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:35 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:35.782286 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a8745de2-6b3e-4392-934c-295d5f052698 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:35.783010 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a8745de2-6b3e-4392-934c-295d5f052698 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:35.789318 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a8745de2-6b3e-4392-934c-295d5f052698 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:35.789765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a8745de2-6b3e-4392-934c-295d5f052698 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:35.790562 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a8745de2-6b3e-4392-934c-295d5f052698 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:35.790996 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a8745de2-6b3e-4392-934c-295d5f052698 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:35.923651 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a8745de2-6b3e-4392-934c-295d5f052698 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:35.931002 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a8745de2-6b3e-4392-934c-295d5f052698 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.152649 May 26 16:58:35.931622 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 64/112] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:35 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:36.014536 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c318d635-8020-4452-b52e-d0586d9fd59c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:36.015155 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c318d635-8020-4452-b52e-d0586d9fd59c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:36.021246 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c318d635-8020-4452-b52e-d0586d9fd59c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:36.021685 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c318d635-8020-4452-b52e-d0586d9fd59c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:36.022665 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c318d635-8020-4452-b52e-d0586d9fd59c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:36.022942 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c318d635-8020-4452-b52e-d0586d9fd59c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:36.152826 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c318d635-8020-4452-b52e-d0586d9fd59c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:36.161120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c318d635-8020-4452-b52e-d0586d9fd59c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.150478 May 26 16:58:36.161687 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 49/113] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:36 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:36.516477 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d96d729e-eff0-4b5f-a578-29880b47c73b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:36.517169 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d96d729e-eff0-4b5f-a578-29880b47c73b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:36.524050 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d96d729e-eff0-4b5f-a578-29880b47c73b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:36.524496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d96d729e-eff0-4b5f-a578-29880b47c73b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:36.525315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d96d729e-eff0-4b5f-a578-29880b47c73b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:36.525742 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d96d729e-eff0-4b5f-a578-29880b47c73b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:36.596684 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-eb43c8bd-34b3-4a6e-8a19-2fe4077e497b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:36.598034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-eb43c8bd-34b3-4a6e-8a19-2fe4077e497b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:36.604002 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb43c8bd-34b3-4a6e-8a19-2fe4077e497b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:36.604448 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb43c8bd-34b3-4a6e-8a19-2fe4077e497b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:36.605208 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb43c8bd-34b3-4a6e-8a19-2fe4077e497b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:36.605638 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb43c8bd-34b3-4a6e-8a19-2fe4077e497b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:36.666941 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d96d729e-eff0-4b5f-a578-29880b47c73b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:36.675814 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d96d729e-eff0-4b5f-a578-29880b47c73b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:36.677434 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d96d729e-eff0-4b5f-a578-29880b47c73b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:36.679104 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d96d729e-eff0-4b5f-a578-29880b47c73b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.166649 May 26 16:58:36.679654 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 65/114] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:36 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:36.749630 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-eb43c8bd-34b3-4a6e-8a19-2fe4077e497b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:36.758058 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-eb43c8bd-34b3-4a6e-8a19-2fe4077e497b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.166465 May 26 16:58:36.758714 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 50/115] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:36 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:36.947954 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-17259dec-c7c4-4790-87af-2977ee093181 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:36.948579 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-17259dec-c7c4-4790-87af-2977ee093181 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:36.958072 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17259dec-c7c4-4790-87af-2977ee093181 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:36.958072 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17259dec-c7c4-4790-87af-2977ee093181 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:36.958072 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17259dec-c7c4-4790-87af-2977ee093181 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:36.958072 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17259dec-c7c4-4790-87af-2977ee093181 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.084940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-17259dec-c7c4-4790-87af-2977ee093181 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:37.092265 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-17259dec-c7c4-4790-87af-2977ee093181 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.148117 May 26 16:58:37.092830 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 66/116] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:36 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:37.178060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9153ec4d-fa49-466a-9817-ed8091b48c9a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:37.178623 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9153ec4d-fa49-466a-9817-ed8091b48c9a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:37.184598 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9153ec4d-fa49-466a-9817-ed8091b48c9a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.185044 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9153ec4d-fa49-466a-9817-ed8091b48c9a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.185806 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9153ec4d-fa49-466a-9817-ed8091b48c9a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.186246 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9153ec4d-fa49-466a-9817-ed8091b48c9a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.323032 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9153ec4d-fa49-466a-9817-ed8091b48c9a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:37.332215 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9153ec4d-fa49-466a-9817-ed8091b48c9a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.158083 May 26 16:58:37.332795 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 51/117] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:37 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:37.697103 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8ee04192-1971-40f3-96ec-9f4a8e6f0421 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:37.697852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8ee04192-1971-40f3-96ec-9f4a8e6f0421 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:37.703877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8ee04192-1971-40f3-96ec-9f4a8e6f0421 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.704339 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8ee04192-1971-40f3-96ec-9f4a8e6f0421 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.705104 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8ee04192-1971-40f3-96ec-9f4a8e6f0421 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.705801 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8ee04192-1971-40f3-96ec-9f4a8e6f0421 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.775109 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e0c06c82-2b57-422b-9aea-bd196dc351c9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:37.775730 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e0c06c82-2b57-422b-9aea-bd196dc351c9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:37.784482 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e0c06c82-2b57-422b-9aea-bd196dc351c9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.787337 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e0c06c82-2b57-422b-9aea-bd196dc351c9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.790165 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e0c06c82-2b57-422b-9aea-bd196dc351c9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.790165 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e0c06c82-2b57-422b-9aea-bd196dc351c9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.863917 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8ee04192-1971-40f3-96ec-9f4a8e6f0421 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:37.875167 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8ee04192-1971-40f3-96ec-9f4a8e6f0421 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:37.877419 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8ee04192-1971-40f3-96ec-9f4a8e6f0421 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:37.878757 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8ee04192-1971-40f3-96ec-9f4a8e6f0421 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.185672 May 26 16:58:37.879551 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 67/118] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:37 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:37.942053 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e0c06c82-2b57-422b-9aea-bd196dc351c9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:37.949605 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e0c06c82-2b57-422b-9aea-bd196dc351c9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.178272 May 26 16:58:37.950128 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 52/119] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:37 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:38.109147 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3f3ab028-858d-4706-9857-2d25c657b1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:38.110283 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3f3ab028-858d-4706-9857-2d25c657b1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:38.116487 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f3ab028-858d-4706-9857-2d25c657b1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:38.118870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f3ab028-858d-4706-9857-2d25c657b1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:38.118870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f3ab028-858d-4706-9857-2d25c657b1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:38.118870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f3ab028-858d-4706-9857-2d25c657b1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:38.248531 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3f3ab028-858d-4706-9857-2d25c657b1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:38.256830 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3f3ab028-858d-4706-9857-2d25c657b1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.151410 May 26 16:58:38.257556 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 68/120] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:38 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:38.349041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b98b6fa7-856d-47de-8813-2dc19f50f38f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:38.349656 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b98b6fa7-856d-47de-8813-2dc19f50f38f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:38.355725 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b98b6fa7-856d-47de-8813-2dc19f50f38f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:38.356174 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b98b6fa7-856d-47de-8813-2dc19f50f38f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:38.356941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b98b6fa7-856d-47de-8813-2dc19f50f38f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:38.357374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b98b6fa7-856d-47de-8813-2dc19f50f38f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:38.489394 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b98b6fa7-856d-47de-8813-2dc19f50f38f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:38.496813 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b98b6fa7-856d-47de-8813-2dc19f50f38f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.151661 May 26 16:58:38.497380 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 53/121] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:38 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:38.897314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-324adf25-cef3-4ea0-95ed-4570aece9bbb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:38.897919 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-324adf25-cef3-4ea0-95ed-4570aece9bbb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:38.903910 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-324adf25-cef3-4ea0-95ed-4570aece9bbb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:38.904351 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-324adf25-cef3-4ea0-95ed-4570aece9bbb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:38.905110 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-324adf25-cef3-4ea0-95ed-4570aece9bbb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:38.905542 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-324adf25-cef3-4ea0-95ed-4570aece9bbb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:38.967635 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b895087a-1c68-4d8d-a626-768c41ddb07e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:38.968203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b895087a-1c68-4d8d-a626-768c41ddb07e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:38.975032 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b895087a-1c68-4d8d-a626-768c41ddb07e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:38.975482 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b895087a-1c68-4d8d-a626-768c41ddb07e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:38.976245 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b895087a-1c68-4d8d-a626-768c41ddb07e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:38.976674 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b895087a-1c68-4d8d-a626-768c41ddb07e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:39.036687 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-324adf25-cef3-4ea0-95ed-4570aece9bbb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:39.044705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-324adf25-cef3-4ea0-95ed-4570aece9bbb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:39.046246 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-324adf25-cef3-4ea0-95ed-4570aece9bbb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:39.047492 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-324adf25-cef3-4ea0-95ed-4570aece9bbb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.153936 May 26 16:58:39.048061 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 69/122] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:38 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:39.106925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b895087a-1c68-4d8d-a626-768c41ddb07e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:39.114507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b895087a-1c68-4d8d-a626-768c41ddb07e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.150554 May 26 16:58:39.115083 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 54/123] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:38 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:39.285101 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-88b6db48-c59b-4e67-8f70-8ffd20231ff1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:39.285706 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-88b6db48-c59b-4e67-8f70-8ffd20231ff1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:39.291653 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-88b6db48-c59b-4e67-8f70-8ffd20231ff1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:39.292091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-88b6db48-c59b-4e67-8f70-8ffd20231ff1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:39.292838 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-88b6db48-c59b-4e67-8f70-8ffd20231ff1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:39.293261 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-88b6db48-c59b-4e67-8f70-8ffd20231ff1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:39.421220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-88b6db48-c59b-4e67-8f70-8ffd20231ff1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:39.429303 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-88b6db48-c59b-4e67-8f70-8ffd20231ff1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.148164 May 26 16:58:39.429942 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 70/124] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:39 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:39.513808 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fd7ae413-b457-4cf9-8089-b84692afea35 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:39.514453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fd7ae413-b457-4cf9-8089-b84692afea35 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:39.521593 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd7ae413-b457-4cf9-8089-b84692afea35 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:39.522048 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd7ae413-b457-4cf9-8089-b84692afea35 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:39.522825 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd7ae413-b457-4cf9-8089-b84692afea35 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:39.523256 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd7ae413-b457-4cf9-8089-b84692afea35 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:39.661284 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fd7ae413-b457-4cf9-8089-b84692afea35 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:39.664877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:39.680569 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fd7ae413-b457-4cf9-8089-b84692afea35 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.159139 May 26 16:58:39.680569 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 55/125] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:39 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:40.065613 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-691f658d-9387-4d26-945e-0004c6a025ba tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:40.066217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-691f658d-9387-4d26-945e-0004c6a025ba tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:40.072367 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-691f658d-9387-4d26-945e-0004c6a025ba tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:40.072896 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-691f658d-9387-4d26-945e-0004c6a025ba tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:40.073662 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-691f658d-9387-4d26-945e-0004c6a025ba tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:40.082001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-691f658d-9387-4d26-945e-0004c6a025ba tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:40.131682 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6aa64991-fbf2-4ba6-ba71-ea4f0a386808 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:40.132289 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6aa64991-fbf2-4ba6-ba71-ea4f0a386808 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:40.138840 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6aa64991-fbf2-4ba6-ba71-ea4f0a386808 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:40.139219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6aa64991-fbf2-4ba6-ba71-ea4f0a386808 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:40.139984 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6aa64991-fbf2-4ba6-ba71-ea4f0a386808 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:40.140431 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6aa64991-fbf2-4ba6-ba71-ea4f0a386808 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:40.205893 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-691f658d-9387-4d26-945e-0004c6a025ba tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:40.219765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-691f658d-9387-4d26-945e-0004c6a025ba tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:40.221437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-691f658d-9387-4d26-945e-0004c6a025ba tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:40.222594 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-691f658d-9387-4d26-945e-0004c6a025ba tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.161027 May 26 16:58:40.223165 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 71/126] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:40 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:40.288901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6aa64991-fbf2-4ba6-ba71-ea4f0a386808 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:40.296513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6aa64991-fbf2-4ba6-ba71-ea4f0a386808 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.169028 May 26 16:58:40.297224 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 56/127] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:40 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:40.446726 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dcbee8a8-53b2-44aa-b10a-d73eccf1842e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:40.447356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-dcbee8a8-53b2-44aa-b10a-d73eccf1842e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:40.453535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dcbee8a8-53b2-44aa-b10a-d73eccf1842e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:40.454742 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dcbee8a8-53b2-44aa-b10a-d73eccf1842e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:40.455501 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dcbee8a8-53b2-44aa-b10a-d73eccf1842e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:40.456195 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dcbee8a8-53b2-44aa-b10a-d73eccf1842e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:40.597309 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dcbee8a8-53b2-44aa-b10a-d73eccf1842e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:40.605568 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-dcbee8a8-53b2-44aa-b10a-d73eccf1842e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.162376 May 26 16:58:40.606361 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 72/128] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:40 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:40.687965 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f7d050a5-5d51-42f7-948a-3a92e3db221f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:40.689091 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f7d050a5-5d51-42f7-948a-3a92e3db221f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:40.695544 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f7d050a5-5d51-42f7-948a-3a92e3db221f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:40.695991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f7d050a5-5d51-42f7-948a-3a92e3db221f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:40.696752 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f7d050a5-5d51-42f7-948a-3a92e3db221f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:40.697178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f7d050a5-5d51-42f7-948a-3a92e3db221f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:40.838474 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f7d050a5-5d51-42f7-948a-3a92e3db221f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:40.846756 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f7d050a5-5d51-42f7-948a-3a92e3db221f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.162641 May 26 16:58:40.847320 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 57/129] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:40 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:41.241098 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a1ce463f-4267-4cef-9da3-2635cf7ffdf7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:41.241701 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a1ce463f-4267-4cef-9da3-2635cf7ffdf7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:41.247979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a1ce463f-4267-4cef-9da3-2635cf7ffdf7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:41.248421 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a1ce463f-4267-4cef-9da3-2635cf7ffdf7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:41.249174 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a1ce463f-4267-4cef-9da3-2635cf7ffdf7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:41.249607 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a1ce463f-4267-4cef-9da3-2635cf7ffdf7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:41.314152 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d3c6316c-9a5b-469f-b10a-ad8dc1359051 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:41.314953 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d3c6316c-9a5b-469f-b10a-ad8dc1359051 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:41.321127 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d3c6316c-9a5b-469f-b10a-ad8dc1359051 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:41.321563 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d3c6316c-9a5b-469f-b10a-ad8dc1359051 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:41.322351 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d3c6316c-9a5b-469f-b10a-ad8dc1359051 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:41.322783 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d3c6316c-9a5b-469f-b10a-ad8dc1359051 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:41.388309 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a1ce463f-4267-4cef-9da3-2635cf7ffdf7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:41.397720 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a1ce463f-4267-4cef-9da3-2635cf7ffdf7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:41.399240 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a1ce463f-4267-4cef-9da3-2635cf7ffdf7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:41.400341 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a1ce463f-4267-4cef-9da3-2635cf7ffdf7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.163173 May 26 16:58:41.400902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 73/130] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:41 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:41.467909 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d3c6316c-9a5b-469f-b10a-ad8dc1359051 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:41.475607 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d3c6316c-9a5b-469f-b10a-ad8dc1359051 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.165868 May 26 16:58:41.476362 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 58/131] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:41 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:41.622691 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d1748a8c-5a7d-4192-b040-34338208f710 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:41.623302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d1748a8c-5a7d-4192-b040-34338208f710 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:41.630795 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d1748a8c-5a7d-4192-b040-34338208f710 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:41.634135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d1748a8c-5a7d-4192-b040-34338208f710 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:41.634135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d1748a8c-5a7d-4192-b040-34338208f710 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:41.634135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d1748a8c-5a7d-4192-b040-34338208f710 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:41.793266 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d1748a8c-5a7d-4192-b040-34338208f710 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:41.802034 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d1748a8c-5a7d-4192-b040-34338208f710 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.183347 May 26 16:58:41.802642 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 74/132] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:41 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:41.863919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-63c8089f-1c43-4f01-83bb-4af7446c0128 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:41.864562 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-63c8089f-1c43-4f01-83bb-4af7446c0128 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:41.867465 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:41.870814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-63c8089f-1c43-4f01-83bb-4af7446c0128 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:41.871258 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-63c8089f-1c43-4f01-83bb-4af7446c0128 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:41.872019 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-63c8089f-1c43-4f01-83bb-4af7446c0128 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:41.872453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-63c8089f-1c43-4f01-83bb-4af7446c0128 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:42.043692 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-63c8089f-1c43-4f01-83bb-4af7446c0128 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:42.051658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-63c8089f-1c43-4f01-83bb-4af7446c0128 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.192280 May 26 16:58:42.052229 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 59/133] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:41 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:42.418509 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7241cc49-b416-4459-a1ed-0899986cd9a2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:42.419235 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7241cc49-b416-4459-a1ed-0899986cd9a2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:42.426027 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7241cc49-b416-4459-a1ed-0899986cd9a2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:42.426508 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7241cc49-b416-4459-a1ed-0899986cd9a2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:42.427273 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7241cc49-b416-4459-a1ed-0899986cd9a2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:42.427701 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7241cc49-b416-4459-a1ed-0899986cd9a2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:42.492695 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a6331412-906e-4d00-8324-d4cefa4d15a0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:42.493506 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a6331412-906e-4d00-8324-d4cefa4d15a0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:42.499725 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a6331412-906e-4d00-8324-d4cefa4d15a0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:42.500628 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a6331412-906e-4d00-8324-d4cefa4d15a0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:42.501608 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a6331412-906e-4d00-8324-d4cefa4d15a0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:42.502235 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a6331412-906e-4d00-8324-d4cefa4d15a0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:42.597217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7241cc49-b416-4459-a1ed-0899986cd9a2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:42.608089 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7241cc49-b416-4459-a1ed-0899986cd9a2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:42.611543 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7241cc49-b416-4459-a1ed-0899986cd9a2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:42.612823 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7241cc49-b416-4459-a1ed-0899986cd9a2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.198217 May 26 16:58:42.623166 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 75/134] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:42 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:42.687389 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a6331412-906e-4d00-8324-d4cefa4d15a0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:42.694978 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a6331412-906e-4d00-8324-d4cefa4d15a0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.205964 May 26 16:58:42.695540 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 60/135] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:42 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:42.818989 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ab690396-781b-4202-9cd7-f458cdcf9a05 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:42.821802 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ab690396-781b-4202-9cd7-f458cdcf9a05 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:42.825492 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ab690396-781b-4202-9cd7-f458cdcf9a05 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:42.825940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ab690396-781b-4202-9cd7-f458cdcf9a05 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:42.826745 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ab690396-781b-4202-9cd7-f458cdcf9a05 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:42.827181 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ab690396-781b-4202-9cd7-f458cdcf9a05 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:42.961696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ab690396-781b-4202-9cd7-f458cdcf9a05 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:42.965192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:42.970621 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ab690396-781b-4202-9cd7-f458cdcf9a05 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.155390 May 26 16:58:42.971699 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 76/136] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:42 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:43.069079 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0e9e8391-aa0c-4c34-9e00-40d73a84960d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:43.069809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0e9e8391-aa0c-4c34-9e00-40d73a84960d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:43.071695 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:43.076498 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0e9e8391-aa0c-4c34-9e00-40d73a84960d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:43.076943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0e9e8391-aa0c-4c34-9e00-40d73a84960d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:43.077894 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0e9e8391-aa0c-4c34-9e00-40d73a84960d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:43.078353 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0e9e8391-aa0c-4c34-9e00-40d73a84960d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:43.276579 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0e9e8391-aa0c-4c34-9e00-40d73a84960d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:43.285223 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0e9e8391-aa0c-4c34-9e00-40d73a84960d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.219913 May 26 16:58:43.286953 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 61/137] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:43 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:43.632219 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c9e06aea-dafc-4429-bdbb-2f06a32b61c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:43.633409 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c9e06aea-dafc-4429-bdbb-2f06a32b61c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:43.650003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c9e06aea-dafc-4429-bdbb-2f06a32b61c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:43.650784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c9e06aea-dafc-4429-bdbb-2f06a32b61c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:43.652758 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c9e06aea-dafc-4429-bdbb-2f06a32b61c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:43.653379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c9e06aea-dafc-4429-bdbb-2f06a32b61c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:43.713902 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f6b0332f-1a12-4de3-8fa9-9447858c1010 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:43.715265 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f6b0332f-1a12-4de3-8fa9-9447858c1010 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:43.721443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f6b0332f-1a12-4de3-8fa9-9447858c1010 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:43.721888 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f6b0332f-1a12-4de3-8fa9-9447858c1010 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:43.722846 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f6b0332f-1a12-4de3-8fa9-9447858c1010 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:43.723282 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f6b0332f-1a12-4de3-8fa9-9447858c1010 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:43.884699 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f6b0332f-1a12-4de3-8fa9-9447858c1010 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:43.894500 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f6b0332f-1a12-4de3-8fa9-9447858c1010 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.184811 May 26 16:58:43.896712 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 62/138] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:43 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:43.989052 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8cef30da-ff6f-4bf9-b049-2732135b8151 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:43.989825 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8cef30da-ff6f-4bf9-b049-2732135b8151 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:43.997553 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8cef30da-ff6f-4bf9-b049-2732135b8151 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:44.009870 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8cef30da-ff6f-4bf9-b049-2732135b8151 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:44.009870 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8cef30da-ff6f-4bf9-b049-2732135b8151 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:44.009870 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8cef30da-ff6f-4bf9-b049-2732135b8151 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:44.025312 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c9e06aea-dafc-4429-bdbb-2f06a32b61c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:44.036349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c9e06aea-dafc-4429-bdbb-2f06a32b61c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:44.038529 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c9e06aea-dafc-4429-bdbb-2f06a32b61c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:44.040029 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c9e06aea-dafc-4429-bdbb-2f06a32b61c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.412153 May 26 16:58:44.041122 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 77/139] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:43 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:44.164738 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8cef30da-ff6f-4bf9-b049-2732135b8151 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:44.172001 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8cef30da-ff6f-4bf9-b049-2732135b8151 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.188640 May 26 16:58:44.177449 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 63/140] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:43 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:44.303333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-caf54271-811e-4b90-83ae-affa9d441c60 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:44.307337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-caf54271-811e-4b90-83ae-affa9d441c60 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:44.310778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-caf54271-811e-4b90-83ae-affa9d441c60 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:44.311230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-caf54271-811e-4b90-83ae-affa9d441c60 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:44.311997 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-caf54271-811e-4b90-83ae-affa9d441c60 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:44.312431 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-caf54271-811e-4b90-83ae-affa9d441c60 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:44.470726 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-caf54271-811e-4b90-83ae-affa9d441c60 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:44.478219 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-caf54271-811e-4b90-83ae-affa9d441c60 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.178694 May 26 16:58:44.478920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 78/141] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:44 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:44.911811 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-14b0bb62-45b1-49aa-95e0-5f8545cf7ec2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:44.912569 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-14b0bb62-45b1-49aa-95e0-5f8545cf7ec2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:44.918444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-14b0bb62-45b1-49aa-95e0-5f8545cf7ec2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:44.918906 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-14b0bb62-45b1-49aa-95e0-5f8545cf7ec2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:44.919624 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-14b0bb62-45b1-49aa-95e0-5f8545cf7ec2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:44.920042 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-14b0bb62-45b1-49aa-95e0-5f8545cf7ec2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:45.062095 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-14b0bb62-45b1-49aa-95e0-5f8545cf7ec2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:45.062233 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-12f4981d-544e-443e-8021-dff60258ce0a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:45.062972 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-12f4981d-544e-443e-8021-dff60258ce0a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:45.066548 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:45.070303 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-14b0bb62-45b1-49aa-95e0-5f8545cf7ec2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.162810 May 26 16:58:45.071130 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12f4981d-544e-443e-8021-dff60258ce0a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:45.071583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12f4981d-544e-443e-8021-dff60258ce0a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:45.079583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12f4981d-544e-443e-8021-dff60258ce0a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:45.079583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12f4981d-544e-443e-8021-dff60258ce0a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:45.079785 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 64/142] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:44 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:45.189652 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-399e5e06-1b61-4bf3-9163-f8d48b587567 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:45.190253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-399e5e06-1b61-4bf3-9163-f8d48b587567 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:45.196349 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-399e5e06-1b61-4bf3-9163-f8d48b587567 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:45.197088 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-399e5e06-1b61-4bf3-9163-f8d48b587567 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:45.204839 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-399e5e06-1b61-4bf3-9163-f8d48b587567 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:45.204839 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-399e5e06-1b61-4bf3-9163-f8d48b587567 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:45.232602 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-12f4981d-544e-443e-8021-dff60258ce0a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:45.243836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-12f4981d-544e-443e-8021-dff60258ce0a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:45.245357 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-12f4981d-544e-443e-8021-dff60258ce0a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:45.246503 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-12f4981d-544e-443e-8021-dff60258ce0a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.191071 May 26 16:58:45.247214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 79/143] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:45 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:45.345661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-399e5e06-1b61-4bf3-9163-f8d48b587567 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:45.353025 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-399e5e06-1b61-4bf3-9163-f8d48b587567 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.167976 May 26 16:58:45.353589 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 65/144] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:45 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:45.495887 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d42613e6-950a-4526-99e1-d75eba9ab320 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:45.496570 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d42613e6-950a-4526-99e1-d75eba9ab320 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:45.502925 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d42613e6-950a-4526-99e1-d75eba9ab320 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:45.503370 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d42613e6-950a-4526-99e1-d75eba9ab320 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:45.504137 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d42613e6-950a-4526-99e1-d75eba9ab320 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:45.504728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d42613e6-950a-4526-99e1-d75eba9ab320 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:45.662898 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d42613e6-950a-4526-99e1-d75eba9ab320 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:45.670937 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d42613e6-950a-4526-99e1-d75eba9ab320 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.178640 May 26 16:58:45.682855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 80/145] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:45 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:46.088853 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fafe369d-a991-4a4d-9fad-b3ea1f97dedb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:46.089569 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fafe369d-a991-4a4d-9fad-b3ea1f97dedb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:46.095727 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fafe369d-a991-4a4d-9fad-b3ea1f97dedb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:46.096171 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fafe369d-a991-4a4d-9fad-b3ea1f97dedb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:46.096942 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fafe369d-a991-4a4d-9fad-b3ea1f97dedb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:46.097353 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fafe369d-a991-4a4d-9fad-b3ea1f97dedb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:46.264809 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-16e53e0f-1a31-4f5e-b69c-34530b628fea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:46.265524 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-16e53e0f-1a31-4f5e-b69c-34530b628fea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:46.272884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-16e53e0f-1a31-4f5e-b69c-34530b628fea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:46.273544 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-16e53e0f-1a31-4f5e-b69c-34530b628fea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:46.274598 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-16e53e0f-1a31-4f5e-b69c-34530b628fea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:46.275179 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-16e53e0f-1a31-4f5e-b69c-34530b628fea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:46.281135 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fafe369d-a991-4a4d-9fad-b3ea1f97dedb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:46.290622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fafe369d-a991-4a4d-9fad-b3ea1f97dedb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.205568 May 26 16:58:46.291310 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 66/146] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:46 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:46.373747 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ef85e7f6-cd70-41fe-bfe4-360eb4e68929 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:46.375084 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ef85e7f6-cd70-41fe-bfe4-360eb4e68929 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:46.388702 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ef85e7f6-cd70-41fe-bfe4-360eb4e68929 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:46.388702 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ef85e7f6-cd70-41fe-bfe4-360eb4e68929 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:46.388702 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ef85e7f6-cd70-41fe-bfe4-360eb4e68929 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:46.388702 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ef85e7f6-cd70-41fe-bfe4-360eb4e68929 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:46.423186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-16e53e0f-1a31-4f5e-b69c-34530b628fea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:46.432798 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-16e53e0f-1a31-4f5e-b69c-34530b628fea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:46.434806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-16e53e0f-1a31-4f5e-b69c-34530b628fea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:46.435948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-16e53e0f-1a31-4f5e-b69c-34530b628fea tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.175074 May 26 16:58:46.436510 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 81/147] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:46 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:58:46.586705 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ef85e7f6-cd70-41fe-bfe4-360eb4e68929 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:46.595551 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ef85e7f6-cd70-41fe-bfe4-360eb4e68929 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.225222 May 26 16:58:46.596981 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 67/148] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:46 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:46.689330 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-aac931e5-e3ee-415f-8f49-fa9c92d837b9 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:46.690082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-aac931e5-e3ee-415f-8f49-fa9c92d837b9 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:46.696195 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aac931e5-e3ee-415f-8f49-fa9c92d837b9 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:46.696653 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aac931e5-e3ee-415f-8f49-fa9c92d837b9 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:46.697802 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aac931e5-e3ee-415f-8f49-fa9c92d837b9 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:46.698410 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aac931e5-e3ee-415f-8f49-fa9c92d837b9 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:46.866708 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-aac931e5-e3ee-415f-8f49-fa9c92d837b9 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:46.876882 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-aac931e5-e3ee-415f-8f49-fa9c92d837b9 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.189351 May 26 16:58:46.877512 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 82/149] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:46 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:47.308249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fe88e242-2b8e-4dac-a82e-1c71fefc9d8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:47.308852 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fe88e242-2b8e-4dac-a82e-1c71fefc9d8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:47.319595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe88e242-2b8e-4dac-a82e-1c71fefc9d8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:47.320179 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe88e242-2b8e-4dac-a82e-1c71fefc9d8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:47.320959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe88e242-2b8e-4dac-a82e-1c71fefc9d8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:47.321390 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe88e242-2b8e-4dac-a82e-1c71fefc9d8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:47.457053 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-56911ce2-6f2b-4fce-8e10-cef991c22e6d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:47.459968 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-56911ce2-6f2b-4fce-8e10-cef991c22e6d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:47.476679 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-56911ce2-6f2b-4fce-8e10-cef991c22e6d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:47.477364 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-56911ce2-6f2b-4fce-8e10-cef991c22e6d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:47.480180 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-56911ce2-6f2b-4fce-8e10-cef991c22e6d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:47.482570 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-56911ce2-6f2b-4fce-8e10-cef991c22e6d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:47.723126 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-56911ce2-6f2b-4fce-8e10-cef991c22e6d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:47.736742 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-56911ce2-6f2b-4fce-8e10-cef991c22e6d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:47.738972 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-56911ce2-6f2b-4fce-8e10-cef991c22e6d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:47.740420 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-56911ce2-6f2b-4fce-8e10-cef991c22e6d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.289436 May 26 16:58:47.741469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 83/150] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:47 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:58:47.747651 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2b5c76f4-c921-48ae-a37a-f17cb99c12aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:47.748661 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2b5c76f4-c921-48ae-a37a-f17cb99c12aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:47.756504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b5c76f4-c921-48ae-a37a-f17cb99c12aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:47.757157 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b5c76f4-c921-48ae-a37a-f17cb99c12aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:47.758104 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b5c76f4-c921-48ae-a37a-f17cb99c12aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:47.758754 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b5c76f4-c921-48ae-a37a-f17cb99c12aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:48.017622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fe88e242-2b8e-4dac-a82e-1c71fefc9d8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:48.025510 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fe88e242-2b8e-4dac-a82e-1c71fefc9d8e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.721086 May 26 16:58:48.028395 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 68/151] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:47 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:48.049262 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-75b89e05-1df5-4253-8914-0afaa58dea51 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:48.051464 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-75b89e05-1df5-4253-8914-0afaa58dea51 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:48.056067 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2b5c76f4-c921-48ae-a37a-f17cb99c12aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:48.064671 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75b89e05-1df5-4253-8914-0afaa58dea51 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:48.065384 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75b89e05-1df5-4253-8914-0afaa58dea51 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:48.066432 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75b89e05-1df5-4253-8914-0afaa58dea51 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:48.067039 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75b89e05-1df5-4253-8914-0afaa58dea51 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:48.087148 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2b5c76f4-c921-48ae-a37a-f17cb99c12aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.334684 May 26 16:58:48.087148 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 84/152] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:47 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:48.760508 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bc635b63-0698-4d6e-bf4f-fdeea348ed7f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:48.761112 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bc635b63-0698-4d6e-bf4f-fdeea348ed7f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:48.769983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bc635b63-0698-4d6e-bf4f-fdeea348ed7f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:48.770465 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bc635b63-0698-4d6e-bf4f-fdeea348ed7f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:48.773472 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bc635b63-0698-4d6e-bf4f-fdeea348ed7f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:48.773916 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bc635b63-0698-4d6e-bf4f-fdeea348ed7f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:48.840443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-75b89e05-1df5-4253-8914-0afaa58dea51 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:48.857152 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-75b89e05-1df5-4253-8914-0afaa58dea51 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.825593 May 26 16:58:48.859093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 69/153] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:48 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:49.213250 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bc635b63-0698-4d6e-bf4f-fdeea348ed7f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:49.222891 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bc635b63-0698-4d6e-bf4f-fdeea348ed7f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:49.224972 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bc635b63-0698-4d6e-bf4f-fdeea348ed7f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:49.226275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bc635b63-0698-4d6e-bf4f-fdeea348ed7f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.470755 May 26 16:58:49.226920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 85/154] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:48 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:58:49.231452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e8e7c3d5-78c4-4739-ac8c-b1b3189effb0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:49.232057 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e8e7c3d5-78c4-4739-ac8c-b1b3189effb0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:49.238355 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8e7c3d5-78c4-4739-ac8c-b1b3189effb0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:49.238800 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8e7c3d5-78c4-4739-ac8c-b1b3189effb0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:49.239721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8e7c3d5-78c4-4739-ac8c-b1b3189effb0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:49.240175 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8e7c3d5-78c4-4739-ac8c-b1b3189effb0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:49.255389 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-1860850b-1f4c-4d80-85cc-a82c40d13edc req-09ba38cc-3f71-45a4-8cbf-ef2c97dfe11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a551b1e0-dd51-440e-bf6f-b0600939ddeb", "tag": "e779a056-07c4-4c1b-a39f-fd638345e925"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:49.265685 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-1860850b-1f4c-4d80-85cc-a82c40d13edc req-09ba38cc-3f71-45a4-8cbf-ef2c97dfe11a service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:49.267210 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-1860850b-1f4c-4d80-85cc-a82c40d13edc req-09ba38cc-3f71-45a4-8cbf-ef2c97dfe11a service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:49.286143 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-1860850b-1f4c-4d80-85cc-a82c40d13edc req-09ba38cc-3f71-45a4-8cbf-ef2c97dfe11a service nova] Creating event network-changed:e779a056-07c4-4c1b-a39f-fd638345e925 for instance a551b1e0-dd51-440e-bf6f-b0600939ddeb on hv-cinder-83607 May 26 16:58:49.298670 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-1860850b-1f4c-4d80-85cc-a82c40d13edc req-09ba38cc-3f71-45a4-8cbf-ef2c97dfe11a service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287335 May 26 16:58:49.298670 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 70/155] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:58:49.302804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-870313ca-4806-4447-b969-00c5138280e4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:49.307430 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-870313ca-4806-4447-b969-00c5138280e4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:49.311667 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-870313ca-4806-4447-b969-00c5138280e4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:49.312281 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-870313ca-4806-4447-b969-00c5138280e4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:49.315962 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-870313ca-4806-4447-b969-00c5138280e4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:49.316405 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-870313ca-4806-4447-b969-00c5138280e4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:49.440783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e8e7c3d5-78c4-4739-ac8c-b1b3189effb0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:49.457061 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e8e7c3d5-78c4-4739-ac8c-b1b3189effb0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.226505 May 26 16:58:49.457061 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 86/156] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:49 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:49.474703 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-ebd6e436-9f3f-4371-9d10-771e15fe0912 req-51690427-43fc-4c03-bb0d-87397c871264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79e5f6d0-3136-4741-a4c4-916b792ee1c8", "tag": "bf8c749f-cafe-414f-850e-85d42f33c2db"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:49.487640 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:49.492066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-ebd6e436-9f3f-4371-9d10-771e15fe0912 req-51690427-43fc-4c03-bb0d-87397c871264 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:49.496032 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-ebd6e436-9f3f-4371-9d10-771e15fe0912 req-51690427-43fc-4c03-bb0d-87397c871264 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:49.515522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-ebd6e436-9f3f-4371-9d10-771e15fe0912 req-51690427-43fc-4c03-bb0d-87397c871264 service nova] Creating event network-changed:bf8c749f-cafe-414f-850e-85d42f33c2db for instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 on hv-cinder-83607 May 26 16:58:49.526055 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-ebd6e436-9f3f-4371-9d10-771e15fe0912 req-51690427-43fc-4c03-bb0d-87397c871264 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060940 May 26 16:58:49.527306 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 87/157] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:49.550934 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-870313ca-4806-4447-b969-00c5138280e4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:49.562016 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-870313ca-4806-4447-b969-00c5138280e4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.265259 May 26 16:58:49.563144 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 71/158] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:49 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:49.879945 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6b5b9910-edbf-4803-b3fc-73d7cf24902c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:49.880640 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6b5b9910-edbf-4803-b3fc-73d7cf24902c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:49.887291 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6b5b9910-edbf-4803-b3fc-73d7cf24902c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:49.887737 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6b5b9910-edbf-4803-b3fc-73d7cf24902c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:49.888500 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6b5b9910-edbf-4803-b3fc-73d7cf24902c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:49.888933 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6b5b9910-edbf-4803-b3fc-73d7cf24902c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.049364 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6b5b9910-edbf-4803-b3fc-73d7cf24902c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:50.057447 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6b5b9910-edbf-4803-b3fc-73d7cf24902c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.182840 May 26 16:58:50.058194 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 88/159] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:49 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:50.246781 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-54a4a8be-c488-4b6a-afe6-bd63fc1f6e8f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:50.248723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-54a4a8be-c488-4b6a-afe6-bd63fc1f6e8f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:50.256542 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-54a4a8be-c488-4b6a-afe6-bd63fc1f6e8f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.256994 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-54a4a8be-c488-4b6a-afe6-bd63fc1f6e8f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.257870 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-54a4a8be-c488-4b6a-afe6-bd63fc1f6e8f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.258555 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-54a4a8be-c488-4b6a-afe6-bd63fc1f6e8f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.424165 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-54a4a8be-c488-4b6a-afe6-bd63fc1f6e8f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:50.451752 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-54a4a8be-c488-4b6a-afe6-bd63fc1f6e8f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:50.454576 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-54a4a8be-c488-4b6a-afe6-bd63fc1f6e8f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:50.456305 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-54a4a8be-c488-4b6a-afe6-bd63fc1f6e8f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.215619 May 26 16:58:50.457037 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 72/160] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:50 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:50.478266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a1370719-8039-4bc1-9071-0c02ebd0ca7f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:50.478266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a1370719-8039-4bc1-9071-0c02ebd0ca7f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:50.479677 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-06895d56-d1c9-4dc2-8fd5-c06c505f5478 req-27422c77-3bec-437a-9414-de4987e02c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27dd101-6b39-40a7-afa5-858040384fcd", "name": "network-vif-plugged", "status": "completed", "tag": "893bcd7a-23df-431b-9d0c-3ea69a22cbb2"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:50.484408 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a1370719-8039-4bc1-9071-0c02ebd0ca7f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.485639 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a1370719-8039-4bc1-9071-0c02ebd0ca7f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.486815 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a1370719-8039-4bc1-9071-0c02ebd0ca7f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.487413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a1370719-8039-4bc1-9071-0c02ebd0ca7f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.495601 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:50.502159 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-06895d56-d1c9-4dc2-8fd5-c06c505f5478 req-27422c77-3bec-437a-9414-de4987e02c97 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.502660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-06895d56-d1c9-4dc2-8fd5-c06c505f5478 req-27422c77-3bec-437a-9414-de4987e02c97 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.520364 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-06895d56-d1c9-4dc2-8fd5-c06c505f5478 req-27422c77-3bec-437a-9414-de4987e02c97 service nova] Creating event network-vif-plugged:893bcd7a-23df-431b-9d0c-3ea69a22cbb2 for instance b27dd101-6b39-40a7-afa5-858040384fcd on hv-cinder-83607 May 26 16:58:50.526535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-06895d56-d1c9-4dc2-8fd5-c06c505f5478 req-27422c77-3bec-437a-9414-de4987e02c97 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147176 May 26 16:58:50.527488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 89/161] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:58:50.597522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1479b8df-17a4-43b7-b4c9-e4f59c1e2155 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:50.598846 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1479b8df-17a4-43b7-b4c9-e4f59c1e2155 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:50.608227 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1479b8df-17a4-43b7-b4c9-e4f59c1e2155 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.609305 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1479b8df-17a4-43b7-b4c9-e4f59c1e2155 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.611543 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1479b8df-17a4-43b7-b4c9-e4f59c1e2155 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.612211 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1479b8df-17a4-43b7-b4c9-e4f59c1e2155 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.660801 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a1370719-8039-4bc1-9071-0c02ebd0ca7f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:50.670783 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a1370719-8039-4bc1-9071-0c02ebd0ca7f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.200299 May 26 16:58:50.672070 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 73/162] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:50 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:50.787079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1479b8df-17a4-43b7-b4c9-e4f59c1e2155 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:50.795096 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1479b8df-17a4-43b7-b4c9-e4f59c1e2155 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.210754 May 26 16:58:50.795666 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 90/163] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:50 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:51.088490 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-abc35a44-cf0f-4ae9-87c0-35a2b175146c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:51.089094 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-abc35a44-cf0f-4ae9-87c0-35a2b175146c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:51.096067 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-abc35a44-cf0f-4ae9-87c0-35a2b175146c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.096511 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-abc35a44-cf0f-4ae9-87c0-35a2b175146c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.097267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-abc35a44-cf0f-4ae9-87c0-35a2b175146c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.097691 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-abc35a44-cf0f-4ae9-87c0-35a2b175146c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.233360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-abc35a44-cf0f-4ae9-87c0-35a2b175146c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:51.240960 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-abc35a44-cf0f-4ae9-87c0-35a2b175146c tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.156650 May 26 16:58:51.241542 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 74/164] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:51 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:51.476196 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4ebdfe86-aefb-4695-9809-fbbce4301d28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:51.476836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4ebdfe86-aefb-4695-9809-fbbce4301d28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:51.484289 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4ebdfe86-aefb-4695-9809-fbbce4301d28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.484289 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4ebdfe86-aefb-4695-9809-fbbce4301d28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.484289 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4ebdfe86-aefb-4695-9809-fbbce4301d28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.484559 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4ebdfe86-aefb-4695-9809-fbbce4301d28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.620302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4ebdfe86-aefb-4695-9809-fbbce4301d28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:51.629080 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4ebdfe86-aefb-4695-9809-fbbce4301d28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:51.630608 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4ebdfe86-aefb-4695-9809-fbbce4301d28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:51.631705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4ebdfe86-aefb-4695-9809-fbbce4301d28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.159660 May 26 16:58:51.632326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 91/165] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:51 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:58:51.689353 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4ec86110-43aa-4be3-82e6-1aaa982138c7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:51.689963 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4ec86110-43aa-4be3-82e6-1aaa982138c7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:51.695897 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4ec86110-43aa-4be3-82e6-1aaa982138c7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.696518 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4ec86110-43aa-4be3-82e6-1aaa982138c7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.703508 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4ec86110-43aa-4be3-82e6-1aaa982138c7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.703969 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4ec86110-43aa-4be3-82e6-1aaa982138c7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.812742 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-784b2d38-0874-415e-8219-a3d71d246048 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:51.814757 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-784b2d38-0874-415e-8219-a3d71d246048 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:51.820870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-784b2d38-0874-415e-8219-a3d71d246048 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.821316 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-784b2d38-0874-415e-8219-a3d71d246048 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.822082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-784b2d38-0874-415e-8219-a3d71d246048 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.822540 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-784b2d38-0874-415e-8219-a3d71d246048 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.839882 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4ec86110-43aa-4be3-82e6-1aaa982138c7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:51.847928 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4ec86110-43aa-4be3-82e6-1aaa982138c7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.162955 May 26 16:58:51.848600 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 75/166] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:51 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:51.953372 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-784b2d38-0874-415e-8219-a3d71d246048 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:51.961316 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-784b2d38-0874-415e-8219-a3d71d246048 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.152506 May 26 16:58:51.961883 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 92/167] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:51 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:52.258798 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-63b94405-70fa-44be-814d-0d70e3e39f40 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:52.259406 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-63b94405-70fa-44be-814d-0d70e3e39f40 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:52.265309 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-63b94405-70fa-44be-814d-0d70e3e39f40 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:52.265763 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-63b94405-70fa-44be-814d-0d70e3e39f40 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:52.266837 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-63b94405-70fa-44be-814d-0d70e3e39f40 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:52.267275 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-63b94405-70fa-44be-814d-0d70e3e39f40 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:52.397321 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-63b94405-70fa-44be-814d-0d70e3e39f40 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:52.404675 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-63b94405-70fa-44be-814d-0d70e3e39f40 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.149830 May 26 16:58:52.405236 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 76/168] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:52 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:52.654686 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-803dadb3-5694-4a75-a0d0-86eb52392d31 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:52.655283 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-803dadb3-5694-4a75-a0d0-86eb52392d31 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:52.661766 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-803dadb3-5694-4a75-a0d0-86eb52392d31 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:52.662201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-803dadb3-5694-4a75-a0d0-86eb52392d31 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:52.663000 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-803dadb3-5694-4a75-a0d0-86eb52392d31 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:52.663413 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-803dadb3-5694-4a75-a0d0-86eb52392d31 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:52.797204 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-803dadb3-5694-4a75-a0d0-86eb52392d31 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:52.805139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-803dadb3-5694-4a75-a0d0-86eb52392d31 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:52.806651 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-803dadb3-5694-4a75-a0d0-86eb52392d31 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:52.807733 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-803dadb3-5694-4a75-a0d0-86eb52392d31 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.157062 May 26 16:58:52.808283 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 93/169] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:52 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:52.867157 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cdf8539e-b3b4-459c-8a6f-347f3245a58b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:52.867766 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cdf8539e-b3b4-459c-8a6f-347f3245a58b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:52.874366 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cdf8539e-b3b4-459c-8a6f-347f3245a58b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:52.874919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cdf8539e-b3b4-459c-8a6f-347f3245a58b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:52.875710 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cdf8539e-b3b4-459c-8a6f-347f3245a58b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:52.876131 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cdf8539e-b3b4-459c-8a6f-347f3245a58b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:52.978722 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-748a30c3-e9c0-4437-9032-7cfd7f742c1f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:52.979328 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-748a30c3-e9c0-4437-9032-7cfd7f742c1f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:52.986345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-748a30c3-e9c0-4437-9032-7cfd7f742c1f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:52.986953 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-748a30c3-e9c0-4437-9032-7cfd7f742c1f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:52.987808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-748a30c3-e9c0-4437-9032-7cfd7f742c1f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:52.988317 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-748a30c3-e9c0-4437-9032-7cfd7f742c1f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:53.004700 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cdf8539e-b3b4-459c-8a6f-347f3245a58b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:53.012159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cdf8539e-b3b4-459c-8a6f-347f3245a58b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.149742 May 26 16:58:53.012730 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 77/170] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:52 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:53.116391 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-748a30c3-e9c0-4437-9032-7cfd7f742c1f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:53.119915 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:53.124318 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-748a30c3-e9c0-4437-9032-7cfd7f742c1f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.149402 May 26 16:58:53.124877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 94/171] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:52 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:53.422511 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-253c0679-445e-4a27-9e6d-80694e29dd24 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:53.423134 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-253c0679-445e-4a27-9e6d-80694e29dd24 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:53.429103 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-253c0679-445e-4a27-9e6d-80694e29dd24 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:53.429548 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-253c0679-445e-4a27-9e6d-80694e29dd24 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:53.430298 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-253c0679-445e-4a27-9e6d-80694e29dd24 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:53.430759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-253c0679-445e-4a27-9e6d-80694e29dd24 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:53.564043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-253c0679-445e-4a27-9e6d-80694e29dd24 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:53.571715 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-253c0679-445e-4a27-9e6d-80694e29dd24 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.153185 May 26 16:58:53.572230 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 78/172] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:53 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:53.826846 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-290d5bbe-ec21-4118-b526-04bba7d4d084 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:53.827355 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-290d5bbe-ec21-4118-b526-04bba7d4d084 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:53.834653 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-290d5bbe-ec21-4118-b526-04bba7d4d084 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:53.835097 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-290d5bbe-ec21-4118-b526-04bba7d4d084 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:53.835851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-290d5bbe-ec21-4118-b526-04bba7d4d084 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:53.836280 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-290d5bbe-ec21-4118-b526-04bba7d4d084 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:53.963478 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-290d5bbe-ec21-4118-b526-04bba7d4d084 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:53.971515 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-290d5bbe-ec21-4118-b526-04bba7d4d084 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:53.973004 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-290d5bbe-ec21-4118-b526-04bba7d4d084 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:53.974101 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-290d5bbe-ec21-4118-b526-04bba7d4d084 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.151673 May 26 16:58:53.974680 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 95/173] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:53 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:54.029122 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c83c63ee-5814-44e4-b897-91fe6fe2000f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:54.029731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c83c63ee-5814-44e4-b897-91fe6fe2000f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:54.035991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c83c63ee-5814-44e4-b897-91fe6fe2000f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.036440 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c83c63ee-5814-44e4-b897-91fe6fe2000f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:54.037199 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c83c63ee-5814-44e4-b897-91fe6fe2000f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.037633 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c83c63ee-5814-44e4-b897-91fe6fe2000f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:54.141059 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ed08e76c-907c-4c08-9e01-3e4e1f03b52e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:54.141790 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ed08e76c-907c-4c08-9e01-3e4e1f03b52e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:54.147715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ed08e76c-907c-4c08-9e01-3e4e1f03b52e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.148220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ed08e76c-907c-4c08-9e01-3e4e1f03b52e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:54.149038 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ed08e76c-907c-4c08-9e01-3e4e1f03b52e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.149529 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ed08e76c-907c-4c08-9e01-3e4e1f03b52e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:54.163575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c83c63ee-5814-44e4-b897-91fe6fe2000f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:54.171245 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c83c63ee-5814-44e4-b897-91fe6fe2000f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.145952 May 26 16:58:54.172543 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 79/174] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:54 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:54.277045 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ed08e76c-907c-4c08-9e01-3e4e1f03b52e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:54.285206 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ed08e76c-907c-4c08-9e01-3e4e1f03b52e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.148054 May 26 16:58:54.285769 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 96/175] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:54 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:54.588159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-47e0bd3f-e734-4643-bdcc-237340fd43fb tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:54.588754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-47e0bd3f-e734-4643-bdcc-237340fd43fb tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:54.595275 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-47e0bd3f-e734-4643-bdcc-237340fd43fb tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.595715 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-47e0bd3f-e734-4643-bdcc-237340fd43fb tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:54.596454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-47e0bd3f-e734-4643-bdcc-237340fd43fb tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.596877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-47e0bd3f-e734-4643-bdcc-237340fd43fb tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:54.733869 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-47e0bd3f-e734-4643-bdcc-237340fd43fb tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:54.741549 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-47e0bd3f-e734-4643-bdcc-237340fd43fb tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.157141 May 26 16:58:54.742119 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 80/176] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:54 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:54.991784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-09476858-3106-46d9-80f1-ab1e65dea40a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:54.992390 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-09476858-3106-46d9-80f1-ab1e65dea40a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:54.998786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-09476858-3106-46d9-80f1-ab1e65dea40a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.999233 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-09476858-3106-46d9-80f1-ab1e65dea40a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.000025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-09476858-3106-46d9-80f1-ab1e65dea40a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.001120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-09476858-3106-46d9-80f1-ab1e65dea40a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.131844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-09476858-3106-46d9-80f1-ab1e65dea40a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:55.139601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-09476858-3106-46d9-80f1-ab1e65dea40a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:55.141705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-09476858-3106-46d9-80f1-ab1e65dea40a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:55.142888 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-09476858-3106-46d9-80f1-ab1e65dea40a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.155021 May 26 16:58:55.143445 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 97/177] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:54 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:55.189557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d3bb0144-26bd-4843-a509-f6d056498b25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:55.190169 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d3bb0144-26bd-4843-a509-f6d056498b25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:55.196255 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d3bb0144-26bd-4843-a509-f6d056498b25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.196701 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d3bb0144-26bd-4843-a509-f6d056498b25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.197467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d3bb0144-26bd-4843-a509-f6d056498b25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.197898 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d3bb0144-26bd-4843-a509-f6d056498b25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.301655 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-be78ebdd-20a7-400b-a464-66d6118674a8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:55.302270 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-be78ebdd-20a7-400b-a464-66d6118674a8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:55.308129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-be78ebdd-20a7-400b-a464-66d6118674a8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.308573 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-be78ebdd-20a7-400b-a464-66d6118674a8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.309341 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-be78ebdd-20a7-400b-a464-66d6118674a8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.309774 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-be78ebdd-20a7-400b-a464-66d6118674a8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.326801 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d3bb0144-26bd-4843-a509-f6d056498b25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:55.335577 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d3bb0144-26bd-4843-a509-f6d056498b25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.150600 May 26 16:58:55.336288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 81/178] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:55 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:55.436969 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-be78ebdd-20a7-400b-a464-66d6118674a8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:55.445070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-be78ebdd-20a7-400b-a464-66d6118674a8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.147281 May 26 16:58:55.445622 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 98/179] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:55 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:55.758831 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-373ba54b-f836-4ba3-bfee-380cd26b7a00 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:55.759433 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-373ba54b-f836-4ba3-bfee-380cd26b7a00 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:55.765365 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-373ba54b-f836-4ba3-bfee-380cd26b7a00 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.765808 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-373ba54b-f836-4ba3-bfee-380cd26b7a00 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.766682 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-373ba54b-f836-4ba3-bfee-380cd26b7a00 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.767109 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-373ba54b-f836-4ba3-bfee-380cd26b7a00 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.900233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-373ba54b-f836-4ba3-bfee-380cd26b7a00 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:55.908156 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-373ba54b-f836-4ba3-bfee-380cd26b7a00 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.153153 May 26 16:58:55.908731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 82/180] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:55 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:56.162715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3a897de3-d656-4b63-8bf0-3630b9b67d7a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:56.163401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3a897de3-d656-4b63-8bf0-3630b9b67d7a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:56.169490 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3a897de3-d656-4b63-8bf0-3630b9b67d7a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.169921 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3a897de3-d656-4b63-8bf0-3630b9b67d7a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.170701 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3a897de3-d656-4b63-8bf0-3630b9b67d7a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.171131 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3a897de3-d656-4b63-8bf0-3630b9b67d7a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.299376 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3a897de3-d656-4b63-8bf0-3630b9b67d7a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:56.307306 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3a897de3-d656-4b63-8bf0-3630b9b67d7a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:56.308793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3a897de3-d656-4b63-8bf0-3630b9b67d7a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:56.309880 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3a897de3-d656-4b63-8bf0-3630b9b67d7a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.152322 May 26 16:58:56.310472 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 99/181] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:56 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:56.353085 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7f100726-0abb-4bef-b8bf-bceb3868296a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:56.353706 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7f100726-0abb-4bef-b8bf-bceb3868296a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:56.359768 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7f100726-0abb-4bef-b8bf-bceb3868296a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.360293 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7f100726-0abb-4bef-b8bf-bceb3868296a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.361054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7f100726-0abb-4bef-b8bf-bceb3868296a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.361487 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7f100726-0abb-4bef-b8bf-bceb3868296a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.461144 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-eeb69fc0-7711-4f25-9ea9-a7de04e9d0a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:56.461742 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-eeb69fc0-7711-4f25-9ea9-a7de04e9d0a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:56.467646 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eeb69fc0-7711-4f25-9ea9-a7de04e9d0a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.468083 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eeb69fc0-7711-4f25-9ea9-a7de04e9d0a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.468890 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eeb69fc0-7711-4f25-9ea9-a7de04e9d0a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.469963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eeb69fc0-7711-4f25-9ea9-a7de04e9d0a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.492213 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7f100726-0abb-4bef-b8bf-bceb3868296a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:56.499878 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7f100726-0abb-4bef-b8bf-bceb3868296a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.150682 May 26 16:58:56.501202 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 83/182] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:56 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:56.606031 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-eeb69fc0-7711-4f25-9ea9-a7de04e9d0a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:56.613765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-eeb69fc0-7711-4f25-9ea9-a7de04e9d0a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.156407 May 26 16:58:56.614375 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 100/183] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:56 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:56.925797 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-94d89d66-97b4-452e-bc13-fab83a93b172 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:56.926434 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-94d89d66-97b4-452e-bc13-fab83a93b172 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:56.932304 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-94d89d66-97b4-452e-bc13-fab83a93b172 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.932741 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-94d89d66-97b4-452e-bc13-fab83a93b172 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.933491 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-94d89d66-97b4-452e-bc13-fab83a93b172 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.933921 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-94d89d66-97b4-452e-bc13-fab83a93b172 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:57.071329 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-94d89d66-97b4-452e-bc13-fab83a93b172 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:57.079500 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-94d89d66-97b4-452e-bc13-fab83a93b172 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.157882 May 26 16:58:57.089108 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 84/184] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:56 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:57.328481 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-16b79040-5227-4d75-8133-f55f13cfeaeb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:57.329247 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-16b79040-5227-4d75-8133-f55f13cfeaeb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:57.342575 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-16b79040-5227-4d75-8133-f55f13cfeaeb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:57.343483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-16b79040-5227-4d75-8133-f55f13cfeaeb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:57.345188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-16b79040-5227-4d75-8133-f55f13cfeaeb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:57.345844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-16b79040-5227-4d75-8133-f55f13cfeaeb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:57.519116 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f941acd0-27d2-496d-92b7-684a3fabdee8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:57.520767 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f941acd0-27d2-496d-92b7-684a3fabdee8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:57.527597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f941acd0-27d2-496d-92b7-684a3fabdee8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:57.528344 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f941acd0-27d2-496d-92b7-684a3fabdee8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:57.529286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f941acd0-27d2-496d-92b7-684a3fabdee8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:57.529722 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f941acd0-27d2-496d-92b7-684a3fabdee8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:57.687117 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-16b79040-5227-4d75-8133-f55f13cfeaeb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:57.698939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-16b79040-5227-4d75-8133-f55f13cfeaeb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:57.701469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-16b79040-5227-4d75-8133-f55f13cfeaeb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:57.706884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-16b79040-5227-4d75-8133-f55f13cfeaeb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.381845 May 26 16:58:57.708483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 101/185] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:57 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:57.719948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9fade897-7a6b-4b17-9d8f-66520db33574 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:57.722382 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9fade897-7a6b-4b17-9d8f-66520db33574 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:57.732314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9fade897-7a6b-4b17-9d8f-66520db33574 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:57.732870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9fade897-7a6b-4b17-9d8f-66520db33574 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:57.733736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9fade897-7a6b-4b17-9d8f-66520db33574 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:57.734285 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9fade897-7a6b-4b17-9d8f-66520db33574 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:57.927847 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9fade897-7a6b-4b17-9d8f-66520db33574 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:57.937083 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9fade897-7a6b-4b17-9d8f-66520db33574 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.227271 May 26 16:58:57.938578 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 102/186] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:57 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:58.096836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a94b2544-d41f-47f1-ba1c-0f05932cb75f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:58.097506 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a94b2544-d41f-47f1-ba1c-0f05932cb75f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:58.103607 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a94b2544-d41f-47f1-ba1c-0f05932cb75f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.104135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a94b2544-d41f-47f1-ba1c-0f05932cb75f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:58.104967 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a94b2544-d41f-47f1-ba1c-0f05932cb75f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.105476 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a94b2544-d41f-47f1-ba1c-0f05932cb75f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:58.139732 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f941acd0-27d2-496d-92b7-684a3fabdee8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:58.151382 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f941acd0-27d2-496d-92b7-684a3fabdee8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.636842 May 26 16:58:58.152096 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 85/187] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:57 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:58.255506 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a94b2544-d41f-47f1-ba1c-0f05932cb75f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:58.263849 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a94b2544-d41f-47f1-ba1c-0f05932cb75f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.171575 May 26 16:58:58.264435 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 103/188] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:58 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:58.726247 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e9e359f9-8d8a-4068-b2ef-fff1553313ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:58.726919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e9e359f9-8d8a-4068-b2ef-fff1553313ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:58.732977 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9e359f9-8d8a-4068-b2ef-fff1553313ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.733422 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9e359f9-8d8a-4068-b2ef-fff1553313ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:58.734184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9e359f9-8d8a-4068-b2ef-fff1553313ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.735365 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9e359f9-8d8a-4068-b2ef-fff1553313ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:58.865200 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e9e359f9-8d8a-4068-b2ef-fff1553313ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:58.873147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e9e359f9-8d8a-4068-b2ef-fff1553313ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:58.874765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e9e359f9-8d8a-4068-b2ef-fff1553313ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:58.876439 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e9e359f9-8d8a-4068-b2ef-fff1553313ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.154124 May 26 16:58:58.877002 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 86/189] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:58 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:58.955512 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a3e2139c-f660-435f-b0f4-9447051246c7 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:58.956664 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a3e2139c-f660-435f-b0f4-9447051246c7 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:58.963884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a3e2139c-f660-435f-b0f4-9447051246c7 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.963884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a3e2139c-f660-435f-b0f4-9447051246c7 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:58.964192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a3e2139c-f660-435f-b0f4-9447051246c7 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.964623 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a3e2139c-f660-435f-b0f4-9447051246c7 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.096309 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-70783748-4518-42a8-9840-95c7d03026e1 req-cf36b465-89cf-4b11-bbbe-e4abf2cff1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60352cdb-28fe-49a5-85e8-ae2c9c92b184", "name": "network-vif-plugged", "status": "completed", "tag": "7f96d44e-35cb-48aa-a514-fdf4fed75c08"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:59.104326 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-70783748-4518-42a8-9840-95c7d03026e1 req-cf36b465-89cf-4b11-bbbe-e4abf2cff1f1 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.104765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-70783748-4518-42a8-9840-95c7d03026e1 req-cf36b465-89cf-4b11-bbbe-e4abf2cff1f1 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.116586 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-70783748-4518-42a8-9840-95c7d03026e1 req-cf36b465-89cf-4b11-bbbe-e4abf2cff1f1 service nova] Creating event network-vif-plugged:7f96d44e-35cb-48aa-a514-fdf4fed75c08 for instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 on hv-cinder-83607 May 26 16:58:59.118139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a3e2139c-f660-435f-b0f4-9447051246c7 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:59.121687 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-70783748-4518-42a8-9840-95c7d03026e1 req-cf36b465-89cf-4b11-bbbe-e4abf2cff1f1 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029277 May 26 16:58:59.122611 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 87/190] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:58:59.127215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a3e2139c-f660-435f-b0f4-9447051246c7 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.176510 May 26 16:58:59.127771 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 104/191] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:58 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:59.169146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-bc72d6de-8731-4a04-9195-533fb57b8f54 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:59.169829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-bc72d6de-8731-4a04-9195-533fb57b8f54 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:59.176675 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bc72d6de-8731-4a04-9195-533fb57b8f54 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.177115 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bc72d6de-8731-4a04-9195-533fb57b8f54 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.177859 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bc72d6de-8731-4a04-9195-533fb57b8f54 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.178284 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bc72d6de-8731-4a04-9195-533fb57b8f54 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.280016 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-01f7a13a-bf75-41f9-9a35-70a4f7d5530a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:59.280798 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-01f7a13a-bf75-41f9-9a35-70a4f7d5530a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:59.288076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-01f7a13a-bf75-41f9-9a35-70a4f7d5530a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.288940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-01f7a13a-bf75-41f9-9a35-70a4f7d5530a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.289906 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-01f7a13a-bf75-41f9-9a35-70a4f7d5530a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.290552 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-01f7a13a-bf75-41f9-9a35-70a4f7d5530a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.331645 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bc72d6de-8731-4a04-9195-533fb57b8f54 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:59.341533 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-bc72d6de-8731-4a04-9195-533fb57b8f54 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.176391 May 26 16:58:59.342114 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 88/192] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:59 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:59.427283 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-01f7a13a-bf75-41f9-9a35-70a4f7d5530a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:59.434696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-01f7a13a-bf75-41f9-9a35-70a4f7d5530a tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.158505 May 26 16:58:59.437612 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 105/193] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:58:59 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:59.938655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fd2b2cd7-7de4-40e5-8304-dc1696e31e7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:59.938655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fd2b2cd7-7de4-40e5-8304-dc1696e31e7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:59.938655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd2b2cd7-7de4-40e5-8304-dc1696e31e7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.938655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd2b2cd7-7de4-40e5-8304-dc1696e31e7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.939377 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd2b2cd7-7de4-40e5-8304-dc1696e31e7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.939377 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd2b2cd7-7de4-40e5-8304-dc1696e31e7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.059539 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fd2b2cd7-7de4-40e5-8304-dc1696e31e7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:00.059539 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fd2b2cd7-7de4-40e5-8304-dc1696e31e7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:00.059853 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fd2b2cd7-7de4-40e5-8304-dc1696e31e7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:00.059853 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fd2b2cd7-7de4-40e5-8304-dc1696e31e7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.159079 May 26 16:59:00.059853 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 89/194] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:58:59 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:00.145376 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-17f1a32c-c426-40e2-a919-c0b666447834 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:00.145984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-17f1a32c-c426-40e2-a919-c0b666447834 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:00.151893 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17f1a32c-c426-40e2-a919-c0b666447834 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.155222 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17f1a32c-c426-40e2-a919-c0b666447834 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.155222 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17f1a32c-c426-40e2-a919-c0b666447834 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.155222 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17f1a32c-c426-40e2-a919-c0b666447834 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.293241 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-17f1a32c-c426-40e2-a919-c0b666447834 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:00.298103 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-17f1a32c-c426-40e2-a919-c0b666447834 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.157027 May 26 16:59:00.298712 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 106/195] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:00 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:00.358030 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a177c0d7-fcd3-4395-9f0b-3ea5ee748e84 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:00.358774 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a177c0d7-fcd3-4395-9f0b-3ea5ee748e84 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:00.365145 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a177c0d7-fcd3-4395-9f0b-3ea5ee748e84 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.365588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a177c0d7-fcd3-4395-9f0b-3ea5ee748e84 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.366370 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a177c0d7-fcd3-4395-9f0b-3ea5ee748e84 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.366804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a177c0d7-fcd3-4395-9f0b-3ea5ee748e84 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.385736 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:00.457407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-52fae17a-d4b1-4a23-8086-4d8c06b7a041 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:00.458088 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-52fae17a-d4b1-4a23-8086-4d8c06b7a041 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:00.464706 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52fae17a-d4b1-4a23-8086-4d8c06b7a041 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.465338 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52fae17a-d4b1-4a23-8086-4d8c06b7a041 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.466918 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52fae17a-d4b1-4a23-8086-4d8c06b7a041 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.467510 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52fae17a-d4b1-4a23-8086-4d8c06b7a041 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.536824 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a177c0d7-fcd3-4395-9f0b-3ea5ee748e84 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:00.545049 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a177c0d7-fcd3-4395-9f0b-3ea5ee748e84 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.190813 May 26 16:59:00.545820 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 90/196] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:00 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:00.623720 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-52fae17a-d4b1-4a23-8086-4d8c06b7a041 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:00.630094 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-52fae17a-d4b1-4a23-8086-4d8c06b7a041 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.178363 May 26 16:59:00.631154 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 107/197] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:00 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:01.069905 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f54c29fb-9df2-477d-9229-8873eba594c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:01.070539 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f54c29fb-9df2-477d-9229-8873eba594c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:01.077344 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f54c29fb-9df2-477d-9229-8873eba594c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.077344 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f54c29fb-9df2-477d-9229-8873eba594c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.077985 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f54c29fb-9df2-477d-9229-8873eba594c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.079045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f54c29fb-9df2-477d-9229-8873eba594c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.226181 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f54c29fb-9df2-477d-9229-8873eba594c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:01.234139 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f54c29fb-9df2-477d-9229-8873eba594c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:01.235935 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f54c29fb-9df2-477d-9229-8873eba594c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:01.237033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f54c29fb-9df2-477d-9229-8873eba594c9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.171177 May 26 16:59:01.237598 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 91/198] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:01 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:01.319448 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-89bfaca0-4c0c-4855-8923-8a47abf16a8d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:01.320122 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-89bfaca0-4c0c-4855-8923-8a47abf16a8d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:01.326536 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-89bfaca0-4c0c-4855-8923-8a47abf16a8d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.329976 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-89bfaca0-4c0c-4855-8923-8a47abf16a8d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.329976 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-89bfaca0-4c0c-4855-8923-8a47abf16a8d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.329976 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-89bfaca0-4c0c-4855-8923-8a47abf16a8d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.463470 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-89bfaca0-4c0c-4855-8923-8a47abf16a8d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:01.472748 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-89bfaca0-4c0c-4855-8923-8a47abf16a8d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.157455 May 26 16:59:01.473330 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 108/199] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:01 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:01.562142 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2afb7199-55a3-4bcb-8932-d69325e9b5b1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:01.562757 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-2afb7199-55a3-4bcb-8932-d69325e9b5b1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:01.569706 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2afb7199-55a3-4bcb-8932-d69325e9b5b1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.570146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2afb7199-55a3-4bcb-8932-d69325e9b5b1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.570924 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2afb7199-55a3-4bcb-8932-d69325e9b5b1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.571382 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2afb7199-55a3-4bcb-8932-d69325e9b5b1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.647720 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-167be5b8-aa6c-45b9-a3ba-65ee97947958 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:01.648431 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-167be5b8-aa6c-45b9-a3ba-65ee97947958 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:01.654837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-167be5b8-aa6c-45b9-a3ba-65ee97947958 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.655354 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-167be5b8-aa6c-45b9-a3ba-65ee97947958 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.656193 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-167be5b8-aa6c-45b9-a3ba-65ee97947958 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.656745 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-167be5b8-aa6c-45b9-a3ba-65ee97947958 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.709064 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2afb7199-55a3-4bcb-8932-d69325e9b5b1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:01.716741 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-2afb7199-55a3-4bcb-8932-d69325e9b5b1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.158576 May 26 16:59:01.717318 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 92/200] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:01 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:01.799647 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-167be5b8-aa6c-45b9-a3ba-65ee97947958 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:01.807754 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-167be5b8-aa6c-45b9-a3ba-65ee97947958 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.164255 May 26 16:59:01.809437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 109/201] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:01 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:02.256199 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-dd49031b-4c9c-4952-a150-177205c22266 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:02.256838 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-dd49031b-4c9c-4952-a150-177205c22266 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:02.262882 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dd49031b-4c9c-4952-a150-177205c22266 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.263321 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dd49031b-4c9c-4952-a150-177205c22266 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.264108 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dd49031b-4c9c-4952-a150-177205c22266 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.264542 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dd49031b-4c9c-4952-a150-177205c22266 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.402184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-dd49031b-4c9c-4952-a150-177205c22266 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:02.408231 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-dd49031b-4c9c-4952-a150-177205c22266 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:02.409742 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-dd49031b-4c9c-4952-a150-177205c22266 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:02.410879 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-dd49031b-4c9c-4952-a150-177205c22266 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.158702 May 26 16:59:02.411458 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 93/202] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:02 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:02.489519 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-36e50e85-7c4e-4116-bace-15764ad9ebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:02.490119 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-36e50e85-7c4e-4116-bace-15764ad9ebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:02.496641 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-36e50e85-7c4e-4116-bace-15764ad9ebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.501550 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-36e50e85-7c4e-4116-bace-15764ad9ebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.501550 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-36e50e85-7c4e-4116-bace-15764ad9ebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.501550 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-36e50e85-7c4e-4116-bace-15764ad9ebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.627430 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-36e50e85-7c4e-4116-bace-15764ad9ebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:02.634836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-36e50e85-7c4e-4116-bace-15764ad9ebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.149109 May 26 16:59:02.635405 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 110/203] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:02 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:02.736476 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9756ced3-b46a-483e-81a3-32ebfb508d23 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:02.737132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9756ced3-b46a-483e-81a3-32ebfb508d23 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:02.743679 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9756ced3-b46a-483e-81a3-32ebfb508d23 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.744121 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9756ced3-b46a-483e-81a3-32ebfb508d23 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.744881 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9756ced3-b46a-483e-81a3-32ebfb508d23 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.745305 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9756ced3-b46a-483e-81a3-32ebfb508d23 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.825693 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ad14c603-356f-4172-8aeb-31573dc60f0b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:02.826859 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ad14c603-356f-4172-8aeb-31573dc60f0b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:02.833024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ad14c603-356f-4172-8aeb-31573dc60f0b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.833576 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ad14c603-356f-4172-8aeb-31573dc60f0b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.834508 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ad14c603-356f-4172-8aeb-31573dc60f0b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.834949 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ad14c603-356f-4172-8aeb-31573dc60f0b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.854773 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:03.022504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ad14c603-356f-4172-8aeb-31573dc60f0b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:03.032706 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ad14c603-356f-4172-8aeb-31573dc60f0b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.210318 May 26 16:59:03.033814 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 111/204] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:02 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:03.189070 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9756ced3-b46a-483e-81a3-32ebfb508d23 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:03.210021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9756ced3-b46a-483e-81a3-32ebfb508d23 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.478447 May 26 16:59:03.212963 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 94/205] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:02 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:03.428840 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d2ed9a06-6ac0-461e-a564-6381b3f15e91 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:03.429455 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d2ed9a06-6ac0-461e-a564-6381b3f15e91 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:03.435638 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d2ed9a06-6ac0-461e-a564-6381b3f15e91 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.436088 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d2ed9a06-6ac0-461e-a564-6381b3f15e91 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.436848 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d2ed9a06-6ac0-461e-a564-6381b3f15e91 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.437284 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d2ed9a06-6ac0-461e-a564-6381b3f15e91 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.587213 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d2ed9a06-6ac0-461e-a564-6381b3f15e91 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:03.595996 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d2ed9a06-6ac0-461e-a564-6381b3f15e91 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:03.597832 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d2ed9a06-6ac0-461e-a564-6381b3f15e91 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:03.603782 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d2ed9a06-6ac0-461e-a564-6381b3f15e91 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.175223 May 26 16:59:03.606106 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 112/206] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:03 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:03.653280 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-02d1ff50-e7bb-46b0-9c7b-f6309afafe33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:03.653891 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-02d1ff50-e7bb-46b0-9c7b-f6309afafe33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:03.660457 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-02d1ff50-e7bb-46b0-9c7b-f6309afafe33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.660842 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-02d1ff50-e7bb-46b0-9c7b-f6309afafe33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.661604 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-02d1ff50-e7bb-46b0-9c7b-f6309afafe33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.662034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-02d1ff50-e7bb-46b0-9c7b-f6309afafe33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.791775 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-02d1ff50-e7bb-46b0-9c7b-f6309afafe33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:03.800057 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-02d1ff50-e7bb-46b0-9c7b-f6309afafe33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.151836 May 26 16:59:03.800636 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 95/207] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:03 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:04.049584 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b89454de-3993-4899-a63d-a1b783db421b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:04.050251 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b89454de-3993-4899-a63d-a1b783db421b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:04.056420 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b89454de-3993-4899-a63d-a1b783db421b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.057087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b89454de-3993-4899-a63d-a1b783db421b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.057894 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b89454de-3993-4899-a63d-a1b783db421b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.058342 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b89454de-3993-4899-a63d-a1b783db421b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.220955 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b89454de-3993-4899-a63d-a1b783db421b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:04.227691 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-25d6359e-b393-48c1-bcc4-63961f30e72b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:04.228792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-25d6359e-b393-48c1-bcc4-63961f30e72b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:04.228943 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b89454de-3993-4899-a63d-a1b783db421b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1319 microversion: 2.1 time: 0.183579 May 26 16:59:04.229401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 113/208] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:04 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:04.238922 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-25d6359e-b393-48c1-bcc4-63961f30e72b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.238922 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-25d6359e-b393-48c1-bcc4-63961f30e72b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.238922 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-25d6359e-b393-48c1-bcc4-63961f30e72b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.238922 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-25d6359e-b393-48c1-bcc4-63961f30e72b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.376367 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-25d6359e-b393-48c1-bcc4-63961f30e72b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:04.383590 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-25d6359e-b393-48c1-bcc4-63961f30e72b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.159843 May 26 16:59:04.384152 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 96/209] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:04 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:04.623995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bb9435aa-2ad1-4168-a9c7-e3d603a61eaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:04.624707 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bb9435aa-2ad1-4168-a9c7-e3d603a61eaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:04.631968 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bb9435aa-2ad1-4168-a9c7-e3d603a61eaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.632584 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bb9435aa-2ad1-4168-a9c7-e3d603a61eaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.633422 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bb9435aa-2ad1-4168-a9c7-e3d603a61eaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.633905 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bb9435aa-2ad1-4168-a9c7-e3d603a61eaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.797728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bb9435aa-2ad1-4168-a9c7-e3d603a61eaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:04.807890 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bb9435aa-2ad1-4168-a9c7-e3d603a61eaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:04.809644 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bb9435aa-2ad1-4168-a9c7-e3d603a61eaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:04.821601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bb9435aa-2ad1-4168-a9c7-e3d603a61eaf tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.190748 May 26 16:59:04.821601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 114/210] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:04 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:04.821877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9bf44b74-da27-4a75-aff8-8d7026ceebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:04.821877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9bf44b74-da27-4a75-aff8-8d7026ceebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:04.828437 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9bf44b74-da27-4a75-aff8-8d7026ceebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.829051 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9bf44b74-da27-4a75-aff8-8d7026ceebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.831882 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9bf44b74-da27-4a75-aff8-8d7026ceebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.831882 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9bf44b74-da27-4a75-aff8-8d7026ceebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.040401 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9bf44b74-da27-4a75-aff8-8d7026ceebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:05.048565 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9bf44b74-da27-4a75-aff8-8d7026ceebb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.235415 May 26 16:59:05.049147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 97/211] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:04 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:05.245436 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-120d7a27-ca76-4940-9955-ce6a890caed0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:05.246306 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-120d7a27-ca76-4940-9955-ce6a890caed0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:05.252846 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-120d7a27-ca76-4940-9955-ce6a890caed0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.253369 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-120d7a27-ca76-4940-9955-ce6a890caed0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.254196 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-120d7a27-ca76-4940-9955-ce6a890caed0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.254777 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-120d7a27-ca76-4940-9955-ce6a890caed0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.397043 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-120d7a27-ca76-4940-9955-ce6a890caed0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:05.401481 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-de8424c2-e133-46dc-bb86-51387a1f2a5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:05.402420 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-de8424c2-e133-46dc-bb86-51387a1f2a5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:05.405833 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-120d7a27-ca76-4940-9955-ce6a890caed0 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1505 microversion: 2.1 time: 0.164134 May 26 16:59:05.407743 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 115/212] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:05 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:05.413887 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de8424c2-e133-46dc-bb86-51387a1f2a5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.414349 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de8424c2-e133-46dc-bb86-51387a1f2a5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.415994 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de8424c2-e133-46dc-bb86-51387a1f2a5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.416428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de8424c2-e133-46dc-bb86-51387a1f2a5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.648931 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-de8424c2-e133-46dc-bb86-51387a1f2a5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:05.656544 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-de8424c2-e133-46dc-bb86-51387a1f2a5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1371 microversion: 2.1 time: 0.259351 May 26 16:59:05.659606 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 98/213] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:05 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:05.749075 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-7657dcc0-b86f-45a4-8874-bfe133602907 req-6f4d6a80-756c-41c9-8b01-df7ee2389854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a551b1e0-dd51-440e-bf6f-b0600939ddeb", "name": "network-vif-plugged", "status": "completed", "tag": "e779a056-07c4-4c1b-a39f-fd638345e925"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:05.760208 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-7657dcc0-b86f-45a4-8874-bfe133602907 req-6f4d6a80-756c-41c9-8b01-df7ee2389854 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.760929 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-7657dcc0-b86f-45a4-8874-bfe133602907 req-6f4d6a80-756c-41c9-8b01-df7ee2389854 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.830364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-520726a4-e3e0-4664-b1c3-2a6abb11a88a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:05.830905 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-520726a4-e3e0-4664-b1c3-2a6abb11a88a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:05.831946 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-7657dcc0-b86f-45a4-8874-bfe133602907 req-6f4d6a80-756c-41c9-8b01-df7ee2389854 service nova] Creating event network-vif-plugged:e779a056-07c4-4c1b-a39f-fd638345e925 for instance a551b1e0-dd51-440e-bf6f-b0600939ddeb on hv-cinder-83607 May 26 16:59:05.841137 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-7657dcc0-b86f-45a4-8874-bfe133602907 req-6f4d6a80-756c-41c9-8b01-df7ee2389854 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095546 May 26 16:59:05.841675 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-520726a4-e3e0-4664-b1c3-2a6abb11a88a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.843230 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-520726a4-e3e0-4664-b1c3-2a6abb11a88a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.846219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-520726a4-e3e0-4664-b1c3-2a6abb11a88a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.847153 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-520726a4-e3e0-4664-b1c3-2a6abb11a88a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.847808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 116/214] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:06.070798 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8a3644e8-9e46-4d7d-a2de-d7efae3e5cb3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:06.072413 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8a3644e8-9e46-4d7d-a2de-d7efae3e5cb3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:06.082791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-520726a4-e3e0-4664-b1c3-2a6abb11a88a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:06.085635 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8a3644e8-9e46-4d7d-a2de-d7efae3e5cb3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.086540 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8a3644e8-9e46-4d7d-a2de-d7efae3e5cb3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.087600 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8a3644e8-9e46-4d7d-a2de-d7efae3e5cb3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.088333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8a3644e8-9e46-4d7d-a2de-d7efae3e5cb3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.096229 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-520726a4-e3e0-4664-b1c3-2a6abb11a88a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:06.097957 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-520726a4-e3e0-4664-b1c3-2a6abb11a88a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:06.104689 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-520726a4-e3e0-4664-b1c3-2a6abb11a88a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.273957 May 26 16:59:06.104689 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 99/215] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:05 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:06.368255 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8a3644e8-9e46-4d7d-a2de-d7efae3e5cb3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:06.376717 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8a3644e8-9e46-4d7d-a2de-d7efae3e5cb3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.315024 May 26 16:59:06.388820 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 117/216] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:06 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:06.677496 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ecc34bf8-13df-490f-a406-86cd56b2215e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:06.678653 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ecc34bf8-13df-490f-a406-86cd56b2215e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:06.686083 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ecc34bf8-13df-490f-a406-86cd56b2215e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.687177 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ecc34bf8-13df-490f-a406-86cd56b2215e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.688689 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ecc34bf8-13df-490f-a406-86cd56b2215e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.689211 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ecc34bf8-13df-490f-a406-86cd56b2215e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.926704 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ecc34bf8-13df-490f-a406-86cd56b2215e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:06.933981 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ecc34bf8-13df-490f-a406-86cd56b2215e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1560 microversion: 2.1 time: 0.262004 May 26 16:59:06.934611 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 100/217] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:06 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1560 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:06.951374 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7ddb411c-2553-46e6-9635-2a4a7afbd47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:06.951914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7ddb411c-2553-46e6-9635-2a4a7afbd47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:06.960259 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7ddb411c-2553-46e6-9635-2a4a7afbd47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.960858 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7ddb411c-2553-46e6-9635-2a4a7afbd47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.961630 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7ddb411c-2553-46e6-9635-2a4a7afbd47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.962182 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7ddb411c-2553-46e6-9635-2a4a7afbd47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.104634 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7ddb411c-2553-46e6-9635-2a4a7afbd47c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156795 May 26 16:59:07.105426 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 118/218] 10.222.0.112 () {58 vars in 1279 bytes} [Thu May 26 16:59:06 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:07.122600 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-52d4451e-49f8-49ff-b86a-50fbd1a50144 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:07.122600 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-52d4451e-49f8-49ff-b86a-50fbd1a50144 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:07.128483 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-52d4451e-49f8-49ff-b86a-50fbd1a50144 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.129308 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-52d4451e-49f8-49ff-b86a-50fbd1a50144 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.130580 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-52d4451e-49f8-49ff-b86a-50fbd1a50144 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.130863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-52d4451e-49f8-49ff-b86a-50fbd1a50144 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.399381 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e19b99b9-93dd-4c2e-bd05-56bd33ed73ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:07.400112 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e19b99b9-93dd-4c2e-bd05-56bd33ed73ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:07.412583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e19b99b9-93dd-4c2e-bd05-56bd33ed73ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.412583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e19b99b9-93dd-4c2e-bd05-56bd33ed73ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.412583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e19b99b9-93dd-4c2e-bd05-56bd33ed73ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.412583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e19b99b9-93dd-4c2e-bd05-56bd33ed73ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.466795 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-52d4451e-49f8-49ff-b86a-50fbd1a50144 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:07.477348 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-52d4451e-49f8-49ff-b86a-50fbd1a50144 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:07.479134 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-52d4451e-49f8-49ff-b86a-50fbd1a50144 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:07.480404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-52d4451e-49f8-49ff-b86a-50fbd1a50144 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.367242 May 26 16:59:07.493179 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 101/219] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:07 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:07.584817 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e19b99b9-93dd-4c2e-bd05-56bd33ed73ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:07.602314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e19b99b9-93dd-4c2e-bd05-56bd33ed73ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.206737 May 26 16:59:07.607750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 119/220] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:07 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:08.446031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e4f454cd-94d2-454c-ab24-103d1133827e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a20d4360-4c23-4242-9003-b048a38a4f9e"}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:08.447208 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e4f454cd-94d2-454c-ab24-103d1133827e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:08.453909 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e4f454cd-94d2-454c-ab24-103d1133827e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.454373 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e4f454cd-94d2-454c-ab24-103d1133827e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.455128 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e4f454cd-94d2-454c-ab24-103d1133827e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.455552 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e4f454cd-94d2-454c-ab24-103d1133827e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.501281 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a0b893bb-624b-4813-84e0-da087f946131 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:08.503168 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a0b893bb-624b-4813-84e0-da087f946131 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:08.510853 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a0b893bb-624b-4813-84e0-da087f946131 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.511539 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a0b893bb-624b-4813-84e0-da087f946131 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.512313 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a0b893bb-624b-4813-84e0-da087f946131 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.512935 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a0b893bb-624b-4813-84e0-da087f946131 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.724118 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a0b893bb-624b-4813-84e0-da087f946131 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:08.733876 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a0b893bb-624b-4813-84e0-da087f946131 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:08.736203 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a0b893bb-624b-4813-84e0-da087f946131 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:08.745283 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a0b893bb-624b-4813-84e0-da087f946131 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.249306 May 26 16:59:08.757905 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 120/221] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:08 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:59:08.769461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-52bfe397-dcc5-416f-99f3-57c98b9ae31f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:08.770928 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-52bfe397-dcc5-416f-99f3-57c98b9ae31f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:08.777320 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52bfe397-dcc5-416f-99f3-57c98b9ae31f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.778109 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52bfe397-dcc5-416f-99f3-57c98b9ae31f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.779085 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52bfe397-dcc5-416f-99f3-57c98b9ae31f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.779670 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52bfe397-dcc5-416f-99f3-57c98b9ae31f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.992155 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-52bfe397-dcc5-416f-99f3-57c98b9ae31f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:09.005041 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-52bfe397-dcc5-416f-99f3-57c98b9ae31f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.243712 May 26 16:59:09.006145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 121/222] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:08 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:09.107724 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-9912c6b2-5bd0-45be-ab08-07b3f9e14a28 req-9411b4b0-d18a-4383-84fa-48c75844c59e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60352cdb-28fe-49a5-85e8-ae2c9c92b184", "tag": "7f96d44e-35cb-48aa-a514-fdf4fed75c08"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:09.121400 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-9912c6b2-5bd0-45be-ab08-07b3f9e14a28 req-9411b4b0-d18a-4383-84fa-48c75844c59e service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:09.121999 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-9912c6b2-5bd0-45be-ab08-07b3f9e14a28 req-9411b4b0-d18a-4383-84fa-48c75844c59e service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:09.154149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-9912c6b2-5bd0-45be-ab08-07b3f9e14a28 req-9411b4b0-d18a-4383-84fa-48c75844c59e service nova] Creating event network-changed:7f96d44e-35cb-48aa-a514-fdf4fed75c08 for instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 on hv-cinder-83607 May 26 16:59:09.168734 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-9912c6b2-5bd0-45be-ab08-07b3f9e14a28 req-9411b4b0-d18a-4383-84fa-48c75844c59e service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066862 May 26 16:59:09.169717 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 122/223] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:09.765411 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1a5e4275-bb62-4909-9799-58a70d596792 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:09.766988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1a5e4275-bb62-4909-9799-58a70d596792 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:09.773357 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1a5e4275-bb62-4909-9799-58a70d596792 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:09.774010 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1a5e4275-bb62-4909-9799-58a70d596792 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:09.774825 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1a5e4275-bb62-4909-9799-58a70d596792 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:09.775419 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1a5e4275-bb62-4909-9799-58a70d596792 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:09.959927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1a5e4275-bb62-4909-9799-58a70d596792 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:09.987507 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1a5e4275-bb62-4909-9799-58a70d596792 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:09.991879 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1a5e4275-bb62-4909-9799-58a70d596792 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:09.993034 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1a5e4275-bb62-4909-9799-58a70d596792 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.231804 May 26 16:59:09.993596 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 123/224] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:09 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:59:10.023404 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a29f1d36-8c31-40ad-adf3-62ee074fd965 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:10.025373 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a29f1d36-8c31-40ad-adf3-62ee074fd965 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:10.035962 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a29f1d36-8c31-40ad-adf3-62ee074fd965 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:10.036661 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a29f1d36-8c31-40ad-adf3-62ee074fd965 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:10.037543 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a29f1d36-8c31-40ad-adf3-62ee074fd965 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:10.040444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a29f1d36-8c31-40ad-adf3-62ee074fd965 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:10.266763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a29f1d36-8c31-40ad-adf3-62ee074fd965 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:10.281762 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a29f1d36-8c31-40ad-adf3-62ee074fd965 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.261850 May 26 16:59:10.288184 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 124/225] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:10 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:10.927302 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e4f454cd-94d2-454c-ab24-103d1133827e tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "POST /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.485017 May 26 16:59:10.928753 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 102/226] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 16:59:08 2022] POST /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd/os-volume_attachments => generated 194 bytes in 2487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:11.012457 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7f86789d-9fa3-4289-bfd0-b5c5198eff10 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:11.013138 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7f86789d-9fa3-4289-bfd0-b5c5198eff10 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:11.020137 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f86789d-9fa3-4289-bfd0-b5c5198eff10 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:11.020587 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f86789d-9fa3-4289-bfd0-b5c5198eff10 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:11.021542 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f86789d-9fa3-4289-bfd0-b5c5198eff10 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:11.021989 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f86789d-9fa3-4289-bfd0-b5c5198eff10 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:11.156836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7f86789d-9fa3-4289-bfd0-b5c5198eff10 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:11.164812 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7f86789d-9fa3-4289-bfd0-b5c5198eff10 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:11.166307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7f86789d-9fa3-4289-bfd0-b5c5198eff10 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:11.173830 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7f86789d-9fa3-4289-bfd0-b5c5198eff10 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.159066 May 26 16:59:11.174445 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 125/227] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:11 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:11.302814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1545ab9f-6b75-42a0-9d3a-ad579193d907 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:11.303509 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1545ab9f-6b75-42a0-9d3a-ad579193d907 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:11.310775 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1545ab9f-6b75-42a0-9d3a-ad579193d907 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:11.311222 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1545ab9f-6b75-42a0-9d3a-ad579193d907 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:11.312163 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1545ab9f-6b75-42a0-9d3a-ad579193d907 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:11.312643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1545ab9f-6b75-42a0-9d3a-ad579193d907 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:11.478107 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1545ab9f-6b75-42a0-9d3a-ad579193d907 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:11.487464 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1545ab9f-6b75-42a0-9d3a-ad579193d907 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1367 microversion: 2.1 time: 0.188918 May 26 16:59:11.488056 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 103/228] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:11 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:12.209324 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c742c26b-5f07-4ffd-8139-37a428bbf7ce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:12.210038 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c742c26b-5f07-4ffd-8139-37a428bbf7ce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:12.224852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c742c26b-5f07-4ffd-8139-37a428bbf7ce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:12.225320 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c742c26b-5f07-4ffd-8139-37a428bbf7ce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:12.226124 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c742c26b-5f07-4ffd-8139-37a428bbf7ce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:12.226761 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c742c26b-5f07-4ffd-8139-37a428bbf7ce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:12.495214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c742c26b-5f07-4ffd-8139-37a428bbf7ce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:12.505278 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-84b9fc73-cc2d-49b3-a314-a7eb0046f53b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:12.505778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c742c26b-5f07-4ffd-8139-37a428bbf7ce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:12.505876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-84b9fc73-cc2d-49b3-a314-a7eb0046f53b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:12.507037 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c742c26b-5f07-4ffd-8139-37a428bbf7ce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:12.508510 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c742c26b-5f07-4ffd-8139-37a428bbf7ce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.319694 May 26 16:59:12.508662 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=89 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:12.510001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 126/229] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:12 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:12.528102 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-84b9fc73-cc2d-49b3-a314-a7eb0046f53b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:12.529248 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-84b9fc73-cc2d-49b3-a314-a7eb0046f53b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:12.530188 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-84b9fc73-cc2d-49b3-a314-a7eb0046f53b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:12.531313 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-84b9fc73-cc2d-49b3-a314-a7eb0046f53b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:12.725760 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-84b9fc73-cc2d-49b3-a314-a7eb0046f53b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:12.735784 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-84b9fc73-cc2d-49b3-a314-a7eb0046f53b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1554 microversion: 2.1 time: 0.234376 May 26 16:59:12.736545 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 104/230] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:12 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:12.753404 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-21f6abc9-de5b-4898-915d-dcb7fa989cbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:12.754126 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-21f6abc9-de5b-4898-915d-dcb7fa989cbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:12.760248 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-21f6abc9-de5b-4898-915d-dcb7fa989cbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:12.760776 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-21f6abc9-de5b-4898-915d-dcb7fa989cbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:12.761440 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-21f6abc9-de5b-4898-915d-dcb7fa989cbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:12.762168 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-21f6abc9-de5b-4898-915d-dcb7fa989cbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:12.851078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-21f6abc9-de5b-4898-915d-dcb7fa989cbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101931 May 26 16:59:12.851835 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 127/231] 10.222.0.112 () {58 vars in 1279 bytes} [Thu May 26 16:59:12 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:13.527814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1e9e8678-9d2a-4c9e-9781-35bb786a9cce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:13.528414 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1e9e8678-9d2a-4c9e-9781-35bb786a9cce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:13.546722 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1e9e8678-9d2a-4c9e-9781-35bb786a9cce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:13.547416 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1e9e8678-9d2a-4c9e-9781-35bb786a9cce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:13.550771 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1e9e8678-9d2a-4c9e-9781-35bb786a9cce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:13.551903 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1e9e8678-9d2a-4c9e-9781-35bb786a9cce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:13.869020 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1e9e8678-9d2a-4c9e-9781-35bb786a9cce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:13.872387 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:13.877455 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1e9e8678-9d2a-4c9e-9781-35bb786a9cce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:13.879007 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1e9e8678-9d2a-4c9e-9781-35bb786a9cce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:13.880111 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1e9e8678-9d2a-4c9e-9781-35bb786a9cce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.356158 May 26 16:59:13.881890 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 105/232] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:13 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:14.124722 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-adbf614a-1f1d-4917-b75d-8f9b1a3f81f0 req-248f278b-d01a-441b-b4d9-eed6886df91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e5f6d0-3136-4741-a4c4-916b792ee1c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf8c749f-cafe-414f-850e-85d42f33c2db"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:14.143167 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-adbf614a-1f1d-4917-b75d-8f9b1a3f81f0 req-248f278b-d01a-441b-b4d9-eed6886df91e service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:14.144386 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-adbf614a-1f1d-4917-b75d-8f9b1a3f81f0 req-248f278b-d01a-441b-b4d9-eed6886df91e service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:14.173060 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-adbf614a-1f1d-4917-b75d-8f9b1a3f81f0 req-248f278b-d01a-441b-b4d9-eed6886df91e service nova] Creating event network-vif-plugged:bf8c749f-cafe-414f-850e-85d42f33c2db for instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 on hv-cinder-83607 May 26 16:59:14.180637 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-adbf614a-1f1d-4917-b75d-8f9b1a3f81f0 req-248f278b-d01a-441b-b4d9-eed6886df91e service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060699 May 26 16:59:14.181606 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 128/233] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:14.539420 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-efae51dc-808d-4a3b-8da9-b91c5961685e req-f0af7cc2-b3e8-4e5b-843d-a280ddb78463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a551b1e0-dd51-440e-bf6f-b0600939ddeb", "tag": "e779a056-07c4-4c1b-a39f-fd638345e925"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:14.553316 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-efae51dc-808d-4a3b-8da9-b91c5961685e req-f0af7cc2-b3e8-4e5b-843d-a280ddb78463 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:14.553791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-efae51dc-808d-4a3b-8da9-b91c5961685e req-f0af7cc2-b3e8-4e5b-843d-a280ddb78463 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:14.588159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-efae51dc-808d-4a3b-8da9-b91c5961685e req-f0af7cc2-b3e8-4e5b-843d-a280ddb78463 service nova] Creating event network-changed:e779a056-07c4-4c1b-a39f-fd638345e925 for instance a551b1e0-dd51-440e-bf6f-b0600939ddeb on hv-cinder-83607 May 26 16:59:14.596396 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-efae51dc-808d-4a3b-8da9-b91c5961685e req-f0af7cc2-b3e8-4e5b-843d-a280ddb78463 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061583 May 26 16:59:14.601329 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 106/234] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:14.899851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-60b55592-ef2e-435b-be91-f4809a38d0b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:14.901666 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-60b55592-ef2e-435b-be91-f4809a38d0b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:14.915015 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-60b55592-ef2e-435b-be91-f4809a38d0b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:14.917979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-60b55592-ef2e-435b-be91-f4809a38d0b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:14.925316 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-60b55592-ef2e-435b-be91-f4809a38d0b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:14.926655 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-60b55592-ef2e-435b-be91-f4809a38d0b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:15.131152 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-60b55592-ef2e-435b-be91-f4809a38d0b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:15.142797 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-60b55592-ef2e-435b-be91-f4809a38d0b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:15.144301 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-60b55592-ef2e-435b-be91-f4809a38d0b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:15.145626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-60b55592-ef2e-435b-be91-f4809a38d0b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.250195 May 26 16:59:15.146214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 129/235] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:14 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:16.165272 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c34d4f45-5f57-472c-b139-63398a2be93e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:16.166045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c34d4f45-5f57-472c-b139-63398a2be93e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:16.173837 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c34d4f45-5f57-472c-b139-63398a2be93e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:16.174281 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c34d4f45-5f57-472c-b139-63398a2be93e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:16.175138 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c34d4f45-5f57-472c-b139-63398a2be93e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:16.175584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c34d4f45-5f57-472c-b139-63398a2be93e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:16.322191 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c34d4f45-5f57-472c-b139-63398a2be93e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:16.332205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c34d4f45-5f57-472c-b139-63398a2be93e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:16.334404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c34d4f45-5f57-472c-b139-63398a2be93e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:16.335832 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c34d4f45-5f57-472c-b139-63398a2be93e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.175892 May 26 16:59:16.336567 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 107/236] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:16 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:17.355099 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2b388550-6cae-40e6-9412-c2206a8ed41d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:17.355753 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2b388550-6cae-40e6-9412-c2206a8ed41d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:17.362722 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b388550-6cae-40e6-9412-c2206a8ed41d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:17.363167 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b388550-6cae-40e6-9412-c2206a8ed41d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:17.363933 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b388550-6cae-40e6-9412-c2206a8ed41d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:17.364417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b388550-6cae-40e6-9412-c2206a8ed41d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:17.497161 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2b388550-6cae-40e6-9412-c2206a8ed41d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:17.501629 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:17.518458 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2b388550-6cae-40e6-9412-c2206a8ed41d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:17.520265 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2b388550-6cae-40e6-9412-c2206a8ed41d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:17.521429 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2b388550-6cae-40e6-9412-c2206a8ed41d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1411 microversion: 2.20 time: 0.170199 May 26 16:59:17.522003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 130/237] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:17 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1411 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:18.541017 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-89ac9116-1c02-4631-87e4-747caac4b569 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:18.541618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-89ac9116-1c02-4631-87e4-747caac4b569 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:18.549277 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-89ac9116-1c02-4631-87e4-747caac4b569 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:18.549749 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-89ac9116-1c02-4631-87e4-747caac4b569 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:18.550526 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-89ac9116-1c02-4631-87e4-747caac4b569 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:18.550958 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-89ac9116-1c02-4631-87e4-747caac4b569 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:18.690781 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-89ac9116-1c02-4631-87e4-747caac4b569 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:18.698687 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-89ac9116-1c02-4631-87e4-747caac4b569 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:18.700184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-89ac9116-1c02-4631-87e4-747caac4b569 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:18.701327 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-89ac9116-1c02-4631-87e4-747caac4b569 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1602 microversion: 2.20 time: 0.164245 May 26 16:59:18.701920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 108/238] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 16:59:18 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:18.723260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c7b77d07-4e65-4e25-ac72-f9c5cb9cf940 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:18.724155 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c7b77d07-4e65-4e25-ac72-f9c5cb9cf940 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:18.731434 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c7b77d07-4e65-4e25-ac72-f9c5cb9cf940 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:18.731885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c7b77d07-4e65-4e25-ac72-f9c5cb9cf940 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:18.732669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c7b77d07-4e65-4e25-ac72-f9c5cb9cf940 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:18.733107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c7b77d07-4e65-4e25-ac72-f9c5cb9cf940 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:18.814781 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c7b77d07-4e65-4e25-ac72-f9c5cb9cf940 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097983 May 26 16:59:18.815565 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 131/239] 10.222.0.112 () {60 vars in 1320 bytes} [Thu May 26 16:59:18 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:59:20.061436 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-c804ada3-3468-4e3f-a9bd-77b2ee2f3d2b req-ba0c674b-fcb6-4726-bed6-f8b18704007e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79e5f6d0-3136-4741-a4c4-916b792ee1c8", "tag": "bf8c749f-cafe-414f-850e-85d42f33c2db"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:20.073272 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-c804ada3-3468-4e3f-a9bd-77b2ee2f3d2b req-ba0c674b-fcb6-4726-bed6-f8b18704007e service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:20.075046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-c804ada3-3468-4e3f-a9bd-77b2ee2f3d2b req-ba0c674b-fcb6-4726-bed6-f8b18704007e service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:20.092090 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-c804ada3-3468-4e3f-a9bd-77b2ee2f3d2b req-ba0c674b-fcb6-4726-bed6-f8b18704007e service nova] Creating event network-changed:bf8c749f-cafe-414f-850e-85d42f33c2db for instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 on hv-cinder-83607 May 26 16:59:20.098219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-c804ada3-3468-4e3f-a9bd-77b2ee2f3d2b req-ba0c674b-fcb6-4726-bed6-f8b18704007e service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042349 May 26 16:59:20.099011 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 109/240] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:23.447553 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2358f96b-0a8a-48b5-849e-a02208371842 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:23.448037 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2358f96b-0a8a-48b5-849e-a02208371842 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:23.449901 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=89 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:23.455376 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2358f96b-0a8a-48b5-849e-a02208371842 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:23.455784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2358f96b-0a8a-48b5-849e-a02208371842 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:23.456839 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2358f96b-0a8a-48b5-849e-a02208371842 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:23.457280 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2358f96b-0a8a-48b5-849e-a02208371842 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:23.481967 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2358f96b-0a8a-48b5-849e-a02208371842 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Going to try to terminate instance {{(pid=130526) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:59:23.733506 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2358f96b-0a8a-48b5-849e-a02208371842 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "DELETE /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 204 len: 0 microversion: 2.1 time: 0.289549 May 26 16:59:23.740313 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 132/241] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 16:59:23 2022] DELETE /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:59:23.742872 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b75b913a-4a56-4bdc-9b29-80812591e7fa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:23.743575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b75b913a-4a56-4bdc-9b29-80812591e7fa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:23.751064 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b75b913a-4a56-4bdc-9b29-80812591e7fa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:23.751524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b75b913a-4a56-4bdc-9b29-80812591e7fa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:23.752288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b75b913a-4a56-4bdc-9b29-80812591e7fa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:23.752721 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b75b913a-4a56-4bdc-9b29-80812591e7fa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:23.908766 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b75b913a-4a56-4bdc-9b29-80812591e7fa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:23.917420 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b75b913a-4a56-4bdc-9b29-80812591e7fa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1557 microversion: 2.1 time: 0.178669 May 26 16:59:23.918802 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 110/242] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:23 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:24.936696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b6fd14d5-c58c-434c-a4aa-d1127ca27e56 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:24.937865 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b6fd14d5-c58c-434c-a4aa-d1127ca27e56 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:24.945507 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b6fd14d5-c58c-434c-a4aa-d1127ca27e56 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:24.946790 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b6fd14d5-c58c-434c-a4aa-d1127ca27e56 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:24.946900 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b6fd14d5-c58c-434c-a4aa-d1127ca27e56 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:24.947262 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b6fd14d5-c58c-434c-a4aa-d1127ca27e56 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:25.094284 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b6fd14d5-c58c-434c-a4aa-d1127ca27e56 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:25.102407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b6fd14d5-c58c-434c-a4aa-d1127ca27e56 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1557 microversion: 2.1 time: 0.170605 May 26 16:59:25.102977 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 133/243] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:24 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:26.119944 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b7e1f085-d1d4-4171-8a61-ca1a22329f9f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:26.120590 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b7e1f085-d1d4-4171-8a61-ca1a22329f9f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:26.127074 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b7e1f085-d1d4-4171-8a61-ca1a22329f9f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:26.127526 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b7e1f085-d1d4-4171-8a61-ca1a22329f9f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:26.128292 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b7e1f085-d1d4-4171-8a61-ca1a22329f9f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:26.128726 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b7e1f085-d1d4-4171-8a61-ca1a22329f9f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:26.257680 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b7e1f085-d1d4-4171-8a61-ca1a22329f9f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:26.266239 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b7e1f085-d1d4-4171-8a61-ca1a22329f9f tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1557 microversion: 2.1 time: 0.150053 May 26 16:59:26.266835 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 111/244] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:26 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:27.283534 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c09b9ffe-05cf-4707-a066-f4e537a6086b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:27.284137 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c09b9ffe-05cf-4707-a066-f4e537a6086b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:27.290155 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c09b9ffe-05cf-4707-a066-f4e537a6086b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:27.290632 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c09b9ffe-05cf-4707-a066-f4e537a6086b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:27.291396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c09b9ffe-05cf-4707-a066-f4e537a6086b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:27.291829 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c09b9ffe-05cf-4707-a066-f4e537a6086b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:27.432512 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c09b9ffe-05cf-4707-a066-f4e537a6086b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:27.442991 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c09b9ffe-05cf-4707-a066-f4e537a6086b tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1557 microversion: 2.1 time: 0.163629 May 26 16:59:27.446088 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 134/245] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:27 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:28.463525 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2295722d-6119-4baa-9480-86bc5cfc0690 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:28.464765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-2295722d-6119-4baa-9480-86bc5cfc0690 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:28.472923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2295722d-6119-4baa-9480-86bc5cfc0690 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:28.473375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2295722d-6119-4baa-9480-86bc5cfc0690 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:28.474152 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2295722d-6119-4baa-9480-86bc5cfc0690 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:28.474619 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2295722d-6119-4baa-9480-86bc5cfc0690 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:28.671763 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2295722d-6119-4baa-9480-86bc5cfc0690 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:28.679723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-2295722d-6119-4baa-9480-86bc5cfc0690 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1557 microversion: 2.1 time: 0.220686 May 26 16:59:28.680454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 112/246] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:28 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:28.810078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-9861e856-ab3f-42e8-be67-e34e6434199a req-e3ed69bc-07e4-4aad-aab6-4f46cb38f8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27dd101-6b39-40a7-afa5-858040384fcd", "name": "network-vif-deleted", "tag": "893bcd7a-23df-431b-9d0c-3ea69a22cbb2"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:28.819057 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-9861e856-ab3f-42e8-be67-e34e6434199a req-e3ed69bc-07e4-4aad-aab6-4f46cb38f8c3 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:28.819499 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-9861e856-ab3f-42e8-be67-e34e6434199a req-e3ed69bc-07e4-4aad-aab6-4f46cb38f8c3 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:28.830882 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-9861e856-ab3f-42e8-be67-e34e6434199a req-e3ed69bc-07e4-4aad-aab6-4f46cb38f8c3 service nova] Creating event network-vif-deleted:893bcd7a-23df-431b-9d0c-3ea69a22cbb2 for instance b27dd101-6b39-40a7-afa5-858040384fcd on hv-cinder-83607 May 26 16:59:28.836361 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-9861e856-ab3f-42e8-be67-e34e6434199a req-e3ed69bc-07e4-4aad-aab6-4f46cb38f8c3 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030240 May 26 16:59:28.836922 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 135/247] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:29.696688 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-15079e13-d712-4a29-bdcc-6598a4ad31ff tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:29.697288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-15079e13-d712-4a29-bdcc-6598a4ad31ff tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:29.705590 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-15079e13-d712-4a29-bdcc-6598a4ad31ff tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:29.706263 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-15079e13-d712-4a29-bdcc-6598a4ad31ff tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:29.707350 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-15079e13-d712-4a29-bdcc-6598a4ad31ff tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:29.711256 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-15079e13-d712-4a29-bdcc-6598a4ad31ff tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:29.774489 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-15079e13-d712-4a29-bdcc-6598a4ad31ff tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:29.786307 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-15079e13-d712-4a29-bdcc-6598a4ad31ff tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1350 microversion: 2.1 time: 0.093406 May 26 16:59:29.787095 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 113/248] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:29 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:30.804848 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6852fc6c-3e07-41f6-b62d-7ee2f9173d8d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:30.805547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6852fc6c-3e07-41f6-b62d-7ee2f9173d8d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:30.811780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6852fc6c-3e07-41f6-b62d-7ee2f9173d8d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:30.812838 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6852fc6c-3e07-41f6-b62d-7ee2f9173d8d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:30.813695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6852fc6c-3e07-41f6-b62d-7ee2f9173d8d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:30.814137 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6852fc6c-3e07-41f6-b62d-7ee2f9173d8d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:30.929338 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6852fc6c-3e07-41f6-b62d-7ee2f9173d8d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:30.929338 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6852fc6c-3e07-41f6-b62d-7ee2f9173d8d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:30.929338 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-6852fc6c-3e07-41f6-b62d-7ee2f9173d8d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lazy-loading 'fault' on Instance uuid b27dd101-6b39-40a7-afa5-858040384fcd {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:30.930151 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6852fc6c-3e07-41f6-b62d-7ee2f9173d8d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bdb3e36e5934d1fbf2204cac57be139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642e24c7c239432b93d0e03f7022cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:30.930151 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6852fc6c-3e07-41f6-b62d-7ee2f9173d8d tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 200 len: 1355 microversion: 2.1 time: 0.102367 May 26 16:59:30.930151 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 136/249] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:30 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 1355 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:31.932966 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-761b0c7a-c0a0-4967-988a-96dd41dd3338 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:31.933633 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-761b0c7a-c0a0-4967-988a-96dd41dd3338 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:31.940768 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-761b0c7a-c0a0-4967-988a-96dd41dd3338 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:31.941218 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-761b0c7a-c0a0-4967-988a-96dd41dd3338 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:31.942104 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-761b0c7a-c0a0-4967-988a-96dd41dd3338 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:31.942724 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-761b0c7a-c0a0-4967-988a-96dd41dd3338 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:31.957194 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-761b0c7a-c0a0-4967-988a-96dd41dd3338 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] HTTP exception thrown: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-761b0c7a-c0a0-4967-988a-96dd41dd3338 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Request method failure captured: May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd HTTP/1.1 May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7GOa3AUMjVjGG3jDRLTMk6x-AE61uUJp7jJHG93Wxsf-yOcHzZXBXM9PHWcuOjub5kEBpqYo8B_GReV93YZeowHZ7bOAf1khia3b9EXlaGwWVykKggDo6L_2H5ivevFu7KNYj0BiugHrqA8U5AnycTGPmpCwvoBGJRGptIwZwlyz5U May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 642e24c7c239432b93d0e03f7022cc0e May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-DeleteServersTestJSON-582456775 May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 16:59:31.978046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 16:59:31.979588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/642e24c7c239432b93d0e03f7022cc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/642e24c7c239432b93d0e03f7022cc0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/642e24c7c239432b93d0e03f7022cc0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_642e24c7c239432b93d0e03f7022cc0e"}]}] May 26 16:59:31.979588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-DeleteServersTestJSON-582456775 May 26 16:59:31.979588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 642e24c7c239432b93d0e03f7022cc0e May 26 16:59:31.979588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-DeleteServersTestJSON-582456775 May 26 16:59:31.979588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-DeleteServersTestJSON-582456775-project May 26 16:59:31.979588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 16:59:31.979588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 16:59:31.979588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 5bdb3e36e5934d1fbf2204cac57be139 May 26 16:59:31.979588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-DeleteServersTestJSON-582456775-project May 26 16:59:31.979588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 16:59:31.979588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:31.979588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': 'b27dd101-6b39-40a7-afa5-858040384fcd'} May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:59:31.980829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:31.982473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 16:59:31.983873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-761b0c7a-c0a0-4967-988a-96dd41dd3338 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Returning 404 to user: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:59:31.983873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-761b0c7a-c0a0-4967-988a-96dd41dd3338 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 404 len: 111 microversion: 2.1 time: 0.050575 May 26 16:59:31.983873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 114/250] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:31 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:59:32.103339 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-22712c1d-7694-478f-9ecc-17d7b9c625aa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:32.104606 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-22712c1d-7694-478f-9ecc-17d7b9c625aa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:32.113917 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-22712c1d-7694-478f-9ecc-17d7b9c625aa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:32.114489 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-22712c1d-7694-478f-9ecc-17d7b9c625aa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:32.115513 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-22712c1d-7694-478f-9ecc-17d7b9c625aa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:32.115987 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-22712c1d-7694-478f-9ecc-17d7b9c625aa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:32.141065 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-22712c1d-7694-478f-9ecc-17d7b9c625aa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] HTTP exception thrown: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-22712c1d-7694-478f-9ecc-17d7b9c625aa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Request method failure captured: May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd/os-volume_attachments HTTP/1.1 May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GOa3AUMjVjGG3jDRLTMk6x-AE61uUJp7jJHG93Wxsf-yOcHzZXBXM9PHWcuOjub5kEBpqYo8B_GReV93YZeowHZ7bOAf1khia3b9EXlaGwWVykKggDo6L_2H5ivevFu7KNYj0BiugHrqA8U5AnycTGPmpCwvoBGJRGptIwZwlyz5U May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 642e24c7c239432b93d0e03f7022cc0e May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-DeleteServersTestJSON-582456775 May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 16:59:32.150545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 16:59:32.151684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/642e24c7c239432b93d0e03f7022cc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/642e24c7c239432b93d0e03f7022cc0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/642e24c7c239432b93d0e03f7022cc0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_642e24c7c239432b93d0e03f7022cc0e"}]}] May 26 16:59:32.151684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-DeleteServersTestJSON-582456775 May 26 16:59:32.151684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 642e24c7c239432b93d0e03f7022cc0e May 26 16:59:32.151684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-DeleteServersTestJSON-582456775 May 26 16:59:32.151684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-DeleteServersTestJSON-582456775-project May 26 16:59:32.151684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 16:59:32.151684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 16:59:32.151684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 5bdb3e36e5934d1fbf2204cac57be139 May 26 16:59:32.151684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-DeleteServersTestJSON-582456775-project May 26 16:59:32.151684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 16:59:32.151684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:32.151684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'server_id': 'b27dd101-6b39-40a7-afa5-858040384fcd'} May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:59:32.153288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:32.154379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 16:59:32.156399 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-22712c1d-7694-478f-9ecc-17d7b9c625aa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Returning 404 to user: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:59:32.156399 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-22712c1d-7694-478f-9ecc-17d7b9c625aa tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052448 May 26 16:59:32.156399 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 137/251] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 16:59:32 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:59:33.596842 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8a4bb535-70d1-4613-95cb-cc54418a2504 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:33.597393 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8a4bb535-70d1-4613-95cb-cc54418a2504 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:33.605570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8a4bb535-70d1-4613-95cb-cc54418a2504 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:33.606064 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8a4bb535-70d1-4613-95cb-cc54418a2504 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:33.607058 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8a4bb535-70d1-4613-95cb-cc54418a2504 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:33.607493 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8a4bb535-70d1-4613-95cb-cc54418a2504 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-8a4bb535-70d1-4613-95cb-cc54418a2504 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] HTTP exception thrown: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8a4bb535-70d1-4613-95cb-cc54418a2504 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Request method failure captured: May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: DELETE /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd HTTP/1.1 May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7GOa3AUMjVjGG3jDRLTMk6x-AE61uUJp7jJHG93Wxsf-yOcHzZXBXM9PHWcuOjub5kEBpqYo8B_GReV93YZeowHZ7bOAf1khia3b9EXlaGwWVykKggDo6L_2H5ivevFu7KNYj0BiugHrqA8U5AnycTGPmpCwvoBGJRGptIwZwlyz5U May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 642e24c7c239432b93d0e03f7022cc0e May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-DeleteServersTestJSON-582456775 May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 16:59:33.626621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 16:59:33.628047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/642e24c7c239432b93d0e03f7022cc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/642e24c7c239432b93d0e03f7022cc0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/642e24c7c239432b93d0e03f7022cc0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_642e24c7c239432b93d0e03f7022cc0e"}]}] May 26 16:59:33.628047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-DeleteServersTestJSON-582456775 May 26 16:59:33.628047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 642e24c7c239432b93d0e03f7022cc0e May 26 16:59:33.628047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-DeleteServersTestJSON-582456775 May 26 16:59:33.628047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-DeleteServersTestJSON-582456775-project May 26 16:59:33.628047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 16:59:33.628047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 16:59:33.628047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 5bdb3e36e5934d1fbf2204cac57be139 May 26 16:59:33.628047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-DeleteServersTestJSON-582456775-project May 26 16:59:33.628047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 16:59:33.628047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:33.628047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': 'b27dd101-6b39-40a7-afa5-858040384fcd'} May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:59:33.628844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:33.633792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 16:59:33.635224 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8a4bb535-70d1-4613-95cb-cc54418a2504 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Returning 404 to user: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:59:33.635224 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8a4bb535-70d1-4613-95cb-cc54418a2504 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "DELETE /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 404 len: 111 microversion: 2.1 time: 0.034642 May 26 16:59:33.635224 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 115/252] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 16:59:33 2022] DELETE /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:59:33.642513 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-412669e6-2d0d-4471-950e-a35d91d17721 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:33.643146 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-412669e6-2d0d-4471-950e-a35d91d17721 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] [instance: b27dd101-6b39-40a7-afa5-858040384fcd] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:33.654509 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-412669e6-2d0d-4471-950e-a35d91d17721 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:33.654960 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-412669e6-2d0d-4471-950e-a35d91d17721 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:33.655909 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-412669e6-2d0d-4471-950e-a35d91d17721 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:33.656362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-412669e6-2d0d-4471-950e-a35d91d17721 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:33.671745 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-412669e6-2d0d-4471-950e-a35d91d17721 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] HTTP exception thrown: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-412669e6-2d0d-4471-950e-a35d91d17721 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Request method failure captured: May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd HTTP/1.1 May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GOa3AUMjVjGG3jDRLTMk6x-AE61uUJp7jJHG93Wxsf-yOcHzZXBXM9PHWcuOjub5kEBpqYo8B_GReV93YZeowHZ7bOAf1khia3b9EXlaGwWVykKggDo6L_2H5ivevFu7KNYj0BiugHrqA8U5AnycTGPmpCwvoBGJRGptIwZwlyz5U May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 642e24c7c239432b93d0e03f7022cc0e May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-DeleteServersTestJSON-582456775 May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 16:59:33.674102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 16:59:33.675504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/642e24c7c239432b93d0e03f7022cc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/642e24c7c239432b93d0e03f7022cc0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/642e24c7c239432b93d0e03f7022cc0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_642e24c7c239432b93d0e03f7022cc0e"}]}] May 26 16:59:33.675504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-DeleteServersTestJSON-582456775 May 26 16:59:33.675504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 642e24c7c239432b93d0e03f7022cc0e May 26 16:59:33.675504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-DeleteServersTestJSON-582456775 May 26 16:59:33.675504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-DeleteServersTestJSON-582456775-project May 26 16:59:33.675504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 16:59:33.675504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 16:59:33.675504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 5bdb3e36e5934d1fbf2204cac57be139 May 26 16:59:33.675504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-DeleteServersTestJSON-582456775-project May 26 16:59:33.675504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 16:59:33.675504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:33.675504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'b27dd101-6b39-40a7-afa5-858040384fcd'} May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:59:33.676326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. May 26 16:59:33.677605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 16:59:33.678847 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-412669e6-2d0d-4471-950e-a35d91d17721 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] Returning 404 to user: Instance b27dd101-6b39-40a7-afa5-858040384fcd could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:59:33.678847 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-412669e6-2d0d-4471-950e-a35d91d17721 tempest-DeleteServersTestJSON-582456775 tempest-DeleteServersTestJSON-582456775-project] 10.222.0.112 "GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd" status: 404 len: 111 microversion: 2.1 time: 0.038324 May 26 16:59:33.678847 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 138/253] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:33 2022] GET /compute/v2.1/servers/b27dd101-6b39-40a7-afa5-858040384fcd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:59:46.314429 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=23 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:46.315159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=44 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:46.600535 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-162793643", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:46.683017 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] validate_networks() for [('e0de04a3-e04b-481e-8f6c-fe332bf20519', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:59:47.482023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:59:47.484104 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:59:47.484888 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:59:47.485428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:59:47.486013 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:59:47.504900 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:47.507278 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:47.510193 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:47.511730 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:47.562388 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Getting quotas for project d84da619d6f042ed8ccf92259d52e180. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:59:47.574485 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Getting quotas for user a3ccb15b11de4cfea727f0aa453f6e2b and project d84da619d6f042ed8ccf92259d52e180. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:59:47.595397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:59:47.597808 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:59:47.815243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cfb01fa4-44ea-44ba-b738-744ecf3f4b71 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.508409 May 26 16:59:47.825630 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bb8d745f-54a8-4193-b9f3-3134aa10add7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:47.826973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bb8d745f-54a8-4193-b9f3-3134aa10add7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:47.831010 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:47.831220 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 116/254] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 16:59:46 2022] POST /compute/v2.1/servers => generated 385 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 16:59:47.833053 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:47.900939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bb8d745f-54a8-4193-b9f3-3134aa10add7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:47.920811 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bb8d745f-54a8-4193-b9f3-3134aa10add7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1225 microversion: 2.1 time: 0.098857 May 26 16:59:47.927049 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 139/255] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:47 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:48.092410 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2079483098", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:48.210380 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] validate_networks() for [('e0de04a3-e04b-481e-8f6c-fe332bf20519', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:59:49.106752 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:59:49.107247 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:59:49.110742 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:59:49.110742 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:59:49.113858 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:59:49.142995 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:49.143455 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:49.144267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:49.144706 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:49.197594 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Getting quotas for project d84da619d6f042ed8ccf92259d52e180. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:59:49.207629 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Getting quotas for user a3ccb15b11de4cfea727f0aa453f6e2b and project d84da619d6f042ed8ccf92259d52e180. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:59:49.234766 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:59:49.237109 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:59:49.426567 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a4248f25-2a7e-4c95-9ed3-ed77efd687d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.338727 May 26 16:59:49.432843 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 117/256] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 16:59:48 2022] POST /compute/v2.1/servers => generated 385 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 16:59:49.442422 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bcb824ed-ef57-4023-9948-3d0ad785aec7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:49.443063 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bcb824ed-ef57-4023-9948-3d0ad785aec7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:49.619952 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bcb824ed-ef57-4023-9948-3d0ad785aec7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:49.628064 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bcb824ed-ef57-4023-9948-3d0ad785aec7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1226 microversion: 2.1 time: 0.194398 May 26 16:59:49.632292 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 140/257] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:49 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1226 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:50.657936 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-190c2753-0ea1-41cb-bc3f-a4585c0fb1f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:50.658599 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-190c2753-0ea1-41cb-bc3f-a4585c0fb1f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:50.736449 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-190c2753-0ea1-41cb-bc3f-a4585c0fb1f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:50.741900 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-190c2753-0ea1-41cb-bc3f-a4585c0fb1f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1226 microversion: 2.1 time: 0.095495 May 26 16:59:50.742804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 118/258] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:50 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:51.760940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0db18570-961e-4571-94dc-307590fe7edb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:51.761869 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0db18570-961e-4571-94dc-307590fe7edb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:51.769425 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0db18570-961e-4571-94dc-307590fe7edb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:51.770237 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0db18570-961e-4571-94dc-307590fe7edb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:51.775865 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0db18570-961e-4571-94dc-307590fe7edb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:51.775865 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0db18570-961e-4571-94dc-307590fe7edb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:51.882307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0db18570-961e-4571-94dc-307590fe7edb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:51.895612 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0db18570-961e-4571-94dc-307590fe7edb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1230 microversion: 2.1 time: 0.135514 May 26 16:59:51.921229 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 141/259] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:51 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1230 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:52.915458 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-37c7d21d-c4a8-4855-8e83-9bde885276eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:52.946513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-37c7d21d-c4a8-4855-8e83-9bde885276eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:52.952819 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-37c7d21d-c4a8-4855-8e83-9bde885276eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:52.953297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-37c7d21d-c4a8-4855-8e83-9bde885276eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:52.954058 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-37c7d21d-c4a8-4855-8e83-9bde885276eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:52.954560 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-37c7d21d-c4a8-4855-8e83-9bde885276eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:53.177815 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-37c7d21d-c4a8-4855-8e83-9bde885276eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:53.187205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-37c7d21d-c4a8-4855-8e83-9bde885276eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1278 microversion: 2.1 time: 0.277508 May 26 16:59:53.190048 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 119/260] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:52 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1278 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:54.212213 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7c572ea5-d7dd-4620-b1e0-db94dbb8f2a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:54.213020 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7c572ea5-d7dd-4620-b1e0-db94dbb8f2a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:54.221466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c572ea5-d7dd-4620-b1e0-db94dbb8f2a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:54.226941 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c572ea5-d7dd-4620-b1e0-db94dbb8f2a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:54.226941 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c572ea5-d7dd-4620-b1e0-db94dbb8f2a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:54.226941 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c572ea5-d7dd-4620-b1e0-db94dbb8f2a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:54.329659 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7c572ea5-d7dd-4620-b1e0-db94dbb8f2a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:54.338181 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7c572ea5-d7dd-4620-b1e0-db94dbb8f2a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1286 microversion: 2.1 time: 0.137718 May 26 16:59:54.361357 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 142/261] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:54 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1286 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:55.368744 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2ee74596-2afc-44b3-aa7e-a05923418c8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:55.369993 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-2ee74596-2afc-44b3-aa7e-a05923418c8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:55.383265 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2ee74596-2afc-44b3-aa7e-a05923418c8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:55.385255 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2ee74596-2afc-44b3-aa7e-a05923418c8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:55.386305 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2ee74596-2afc-44b3-aa7e-a05923418c8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:55.387480 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2ee74596-2afc-44b3-aa7e-a05923418c8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:55.818598 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2ee74596-2afc-44b3-aa7e-a05923418c8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:55.831144 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-2ee74596-2afc-44b3-aa7e-a05923418c8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1284 microversion: 2.1 time: 0.466334 May 26 16:59:55.831767 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 120/262] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:55 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1284 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:56.463489 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-280895da-5e0b-48ec-acc8-bc35d6c30fd9 req-11aa6f95-840f-49a0-be10-b7bbb41320a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf36dc82-736a-4235-a29d-663f9341ab63", "tag": "1b2abc71-4545-4f0e-a46c-881b6d72d6b9"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:56.494196 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-280895da-5e0b-48ec-acc8-bc35d6c30fd9 req-11aa6f95-840f-49a0-be10-b7bbb41320a6 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:56.494807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-280895da-5e0b-48ec-acc8-bc35d6c30fd9 req-11aa6f95-840f-49a0-be10-b7bbb41320a6 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:56.541477 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-280895da-5e0b-48ec-acc8-bc35d6c30fd9 req-11aa6f95-840f-49a0-be10-b7bbb41320a6 service nova] Creating event network-changed:1b2abc71-4545-4f0e-a46c-881b6d72d6b9 for instance bf36dc82-736a-4235-a29d-663f9341ab63 on hv-cinder-83607 May 26 16:59:56.566931 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-280895da-5e0b-48ec-acc8-bc35d6c30fd9 req-11aa6f95-840f-49a0-be10-b7bbb41320a6 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100882 May 26 16:59:56.570972 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 143/263] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:56.873264 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9a0e3b4a-72fa-4326-8344-12ef6d71dde9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:56.873264 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9a0e3b4a-72fa-4326-8344-12ef6d71dde9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:56.881454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9a0e3b4a-72fa-4326-8344-12ef6d71dde9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:56.882127 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9a0e3b4a-72fa-4326-8344-12ef6d71dde9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:56.883800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9a0e3b4a-72fa-4326-8344-12ef6d71dde9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:56.884490 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9a0e3b4a-72fa-4326-8344-12ef6d71dde9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:57.432852 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9a0e3b4a-72fa-4326-8344-12ef6d71dde9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:57.441300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9a0e3b4a-72fa-4326-8344-12ef6d71dde9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.593874 May 26 16:59:57.442488 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 121/264] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:56 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:58.463440 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5f03e993-eaea-4f7b-bbb3-de90ddf89694 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:58.463440 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5f03e993-eaea-4f7b-bbb3-de90ddf89694 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:58.470864 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5f03e993-eaea-4f7b-bbb3-de90ddf89694 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:58.473126 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5f03e993-eaea-4f7b-bbb3-de90ddf89694 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:58.474006 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5f03e993-eaea-4f7b-bbb3-de90ddf89694 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:58.474479 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5f03e993-eaea-4f7b-bbb3-de90ddf89694 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:58.725755 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-207db7cb-eef3-47c1-93f0-539f79bb61f4 req-06e0f962-ddda-4981-9fbf-ca78f174e6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc8354d-7f45-4c4a-a590-aeadaad33115", "tag": "ceb32ccc-6e72-46ab-9bdd-73afcc5aa54c"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:58.737553 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-207db7cb-eef3-47c1-93f0-539f79bb61f4 req-06e0f962-ddda-4981-9fbf-ca78f174e6f2 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:58.738001 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-207db7cb-eef3-47c1-93f0-539f79bb61f4 req-06e0f962-ddda-4981-9fbf-ca78f174e6f2 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:58.751105 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-207db7cb-eef3-47c1-93f0-539f79bb61f4 req-06e0f962-ddda-4981-9fbf-ca78f174e6f2 service nova] Creating event network-changed:ceb32ccc-6e72-46ab-9bdd-73afcc5aa54c for instance dfc8354d-7f45-4c4a-a590-aeadaad33115 on hv-cinder-83607 May 26 16:59:58.756796 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-207db7cb-eef3-47c1-93f0-539f79bb61f4 req-06e0f962-ddda-4981-9fbf-ca78f174e6f2 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034572 May 26 16:59:58.758000 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 122/265] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 16:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:59:58.823873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5f03e993-eaea-4f7b-bbb3-de90ddf89694 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:58.832866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5f03e993-eaea-4f7b-bbb3-de90ddf89694 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.376971 May 26 16:59:58.833459 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 144/266] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:58 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:59.850287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-38a83838-3d67-45e0-a032-dc982915a000 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:59.852209 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-38a83838-3d67-45e0-a032-dc982915a000 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:59.854207 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=4 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:59.860280 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-38a83838-3d67-45e0-a032-dc982915a000 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:59.860912 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-38a83838-3d67-45e0-a032-dc982915a000 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:59.861974 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-38a83838-3d67-45e0-a032-dc982915a000 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:59.862582 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-38a83838-3d67-45e0-a032-dc982915a000 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:00.015673 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-38a83838-3d67-45e0-a032-dc982915a000 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:00.023460 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-38a83838-3d67-45e0-a032-dc982915a000 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.178088 May 26 17:00:00.024374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 123/267] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 16:59:59 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:01.041388 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-721084ee-817c-460c-b07e-3db4f4a69f4d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:01.042520 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-721084ee-817c-460c-b07e-3db4f4a69f4d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:01.052390 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=4 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:01.053986 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-721084ee-817c-460c-b07e-3db4f4a69f4d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:01.059836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-721084ee-817c-460c-b07e-3db4f4a69f4d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:01.068170 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-721084ee-817c-460c-b07e-3db4f4a69f4d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:01.068851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-721084ee-817c-460c-b07e-3db4f4a69f4d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:01.308646 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-721084ee-817c-460c-b07e-3db4f4a69f4d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:01.318805 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-721084ee-817c-460c-b07e-3db4f4a69f4d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.281498 May 26 17:00:01.319488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 145/268] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:01 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:02.336941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-19e55205-789b-4327-acdc-c580d9e0e05c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:02.338072 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-19e55205-789b-4327-acdc-c580d9e0e05c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:02.340167 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=14 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:02.350089 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-19e55205-789b-4327-acdc-c580d9e0e05c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:02.350880 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-19e55205-789b-4327-acdc-c580d9e0e05c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:02.351895 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-19e55205-789b-4327-acdc-c580d9e0e05c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:02.352872 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-19e55205-789b-4327-acdc-c580d9e0e05c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:02.864028 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-19e55205-789b-4327-acdc-c580d9e0e05c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:02.872286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-19e55205-789b-4327-acdc-c580d9e0e05c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.539910 May 26 17:00:02.872946 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 124/269] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:02 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:03.893735 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d22a0909-51e7-4904-ad23-faee105dd5bc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:03.895137 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d22a0909-51e7-4904-ad23-faee105dd5bc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:03.904327 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d22a0909-51e7-4904-ad23-faee105dd5bc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:03.905837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d22a0909-51e7-4904-ad23-faee105dd5bc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:03.906892 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d22a0909-51e7-4904-ad23-faee105dd5bc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:03.907333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d22a0909-51e7-4904-ad23-faee105dd5bc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:04.170301 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d22a0909-51e7-4904-ad23-faee105dd5bc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:04.197455 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d22a0909-51e7-4904-ad23-faee105dd5bc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.311760 May 26 17:00:04.199560 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 146/270] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:03 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:04.532339 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8d7c117b-1b6d-453c-a2c8-f2874920ebf8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Action: 'create', calling method: .version_select at 0x7fd25139e9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-214547918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvF2ni1tCMnUe3Vax3kX3n9yKqsc31UznnXt3d4JTZxkex5NZSysqCItkccW4WKogMh1WYK9GsQlLOAgr/vp3+polrxffQdDeaYZVJxa0N9BibbZ82RUGnHxFtpd3XNsg=="}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:04.566213 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-8d7c117b-1b6d-453c-a2c8-f2874920ebf8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Getting quotas for project 3684109c25814f2dadd52c7f00d5e025. Resources: {'key_pairs'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:00:04.576024 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-8d7c117b-1b6d-453c-a2c8-f2874920ebf8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Getting quotas for user 1f3a90c131984e8f8ab7b63679b39adc and project 3684109c25814f2dadd52c7f00d5e025. Resources: {'key_pairs'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:00:04.672813 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8d7c117b-1b6d-453c-a2c8-f2874920ebf8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.145514 May 26 17:00:04.696557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 125/271] 10.222.0.112 () {60 vars in 1163 bytes} [Thu May 26 17:00:04 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:04.825006 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-310665236", "imageRef": "f1be3234-11ba-491b-a094-0b620e7c3f52", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-214547918", "networks": [{"uuid": "646b06b0-388f-4212-8f7d-001aacedce93"}]}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:04.917294 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.network.neutron [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] validate_networks() for [('646b06b0-388f-4212-8f7d-001aacedce93', None, None, None, None, None)] {{(pid=130526) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:00:05.216197 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6e9b9fb1-3ae4-4b48-ad24-51fb20ea779f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:05.222066 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6e9b9fb1-3ae4-4b48-ad24-51fb20ea779f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:05.232449 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6e9b9fb1-3ae4-4b48-ad24-51fb20ea779f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:05.233625 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6e9b9fb1-3ae4-4b48-ad24-51fb20ea779f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:05.234627 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6e9b9fb1-3ae4-4b48-ad24-51fb20ea779f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:05.238479 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6e9b9fb1-3ae4-4b48-ad24-51fb20ea779f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:05.459273 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6e9b9fb1-3ae4-4b48-ad24-51fb20ea779f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:05.470523 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6e9b9fb1-3ae4-4b48-ad24-51fb20ea779f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.259029 May 26 17:00:05.471107 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 126/272] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:05 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:06.046015 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Flavor limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:00:06.046735 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Image limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:00:06.046855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Flavor pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:00:06.047499 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Image pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:00:06.048134 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:00:06.059530 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:06.060824 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:06.078914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:06.079593 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:06.146629 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Getting quotas for project 3684109c25814f2dadd52c7f00d5e025. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:00:06.159209 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Getting quotas for user 1f3a90c131984e8f8ab7b63679b39adc and project 3684109c25814f2dadd52c7f00d5e025. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:00:06.206699 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Going to run 1 instances... {{(pid=130526) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:00:06.211164 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1be3234-11ba-491b-a094-0b620e7c3f52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:00:06.487063 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-519f7353-0f58-459a-b1fe-c268999b146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:06.488243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-519f7353-0f58-459a-b1fe-c268999b146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:06.495234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-519f7353-0f58-459a-b1fe-c268999b146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:06.495690 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-519f7353-0f58-459a-b1fe-c268999b146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:06.496471 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-519f7353-0f58-459a-b1fe-c268999b146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:06.496907 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-519f7353-0f58-459a-b1fe-c268999b146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:06.629618 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-efd0572c-38df-4e9c-bec7-c6dfab4d0b02 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.809083 May 26 17:00:06.635099 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 147/273] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:00:04 2022] POST /compute/v2.1/servers => generated 382 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 17:00:06.641868 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2debdd98-4a47-4d97-abe9-c2f98273d504 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:06.646602 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2debdd98-4a47-4d97-abe9-c2f98273d504 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:06.711871 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2debdd98-4a47-4d97-abe9-c2f98273d504 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:06.722034 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2debdd98-4a47-4d97-abe9-c2f98273d504 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1261 microversion: 2.1 time: 0.084505 May 26 17:00:06.723186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 148/274] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:06 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:06.752037 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-519f7353-0f58-459a-b1fe-c268999b146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:06.767283 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-519f7353-0f58-459a-b1fe-c268999b146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.279393 May 26 17:00:06.767283 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 127/275] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:06 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:07.512128 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-a664b3f7-11a2-4a40-903e-ccede26dcd8c req-033eb719-1763-40ff-b14c-1ee2936e585a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf36dc82-736a-4235-a29d-663f9341ab63", "name": "network-vif-plugged", "status": "completed", "tag": "1b2abc71-4545-4f0e-a46c-881b6d72d6b9"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:07.524775 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-a664b3f7-11a2-4a40-903e-ccede26dcd8c req-033eb719-1763-40ff-b14c-1ee2936e585a service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:07.525300 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-a664b3f7-11a2-4a40-903e-ccede26dcd8c req-033eb719-1763-40ff-b14c-1ee2936e585a service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:07.537810 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-a664b3f7-11a2-4a40-903e-ccede26dcd8c req-033eb719-1763-40ff-b14c-1ee2936e585a service nova] Creating event network-vif-plugged:1b2abc71-4545-4f0e-a46c-881b6d72d6b9 for instance bf36dc82-736a-4235-a29d-663f9341ab63 on hv-cinder-83607 May 26 17:00:07.543173 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-a664b3f7-11a2-4a40-903e-ccede26dcd8c req-033eb719-1763-40ff-b14c-1ee2936e585a service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035507 May 26 17:00:07.543758 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 149/276] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:07.741387 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c1af44ae-1637-4baa-ab34-46b5e6343aa6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:07.742012 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c1af44ae-1637-4baa-ab34-46b5e6343aa6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:07.780549 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-74671114-0971-4110-8fe7-bc52d311156b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:07.781694 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-74671114-0971-4110-8fe7-bc52d311156b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:07.798549 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-74671114-0971-4110-8fe7-bc52d311156b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:07.798549 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-74671114-0971-4110-8fe7-bc52d311156b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:07.798549 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-74671114-0971-4110-8fe7-bc52d311156b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:07.798549 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-74671114-0971-4110-8fe7-bc52d311156b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:07.816935 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c1af44ae-1637-4baa-ab34-46b5e6343aa6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:07.825430 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c1af44ae-1637-4baa-ab34-46b5e6343aa6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1261 microversion: 2.1 time: 0.089103 May 26 17:00:07.827697 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 128/277] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:07 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:07.978642 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-74671114-0971-4110-8fe7-bc52d311156b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:07.992959 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-74671114-0971-4110-8fe7-bc52d311156b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.216895 May 26 17:00:07.993538 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 150/278] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:07 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:08.847067 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6230b1a8-8464-4f5b-8f1d-1b4c4db6b5d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:08.847696 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6230b1a8-8464-4f5b-8f1d-1b4c4db6b5d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:08.872061 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6230b1a8-8464-4f5b-8f1d-1b4c4db6b5d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:08.872584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6230b1a8-8464-4f5b-8f1d-1b4c4db6b5d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:08.902905 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6230b1a8-8464-4f5b-8f1d-1b4c4db6b5d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:08.903479 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6230b1a8-8464-4f5b-8f1d-1b4c4db6b5d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:09.010366 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-298917f0-26b0-4d60-bf62-3f7c17a51e6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:09.011878 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-298917f0-26b0-4d60-bf62-3f7c17a51e6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:09.016329 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6230b1a8-8464-4f5b-8f1d-1b4c4db6b5d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:09.019809 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-298917f0-26b0-4d60-bf62-3f7c17a51e6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:09.027074 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-298917f0-26b0-4d60-bf62-3f7c17a51e6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:09.028197 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-298917f0-26b0-4d60-bf62-3f7c17a51e6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:09.028874 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-298917f0-26b0-4d60-bf62-3f7c17a51e6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:09.029013 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6230b1a8-8464-4f5b-8f1d-1b4c4db6b5d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1265 microversion: 2.1 time: 0.189283 May 26 17:00:09.029566 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 129/279] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:08 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:09.403975 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-298917f0-26b0-4d60-bf62-3f7c17a51e6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:09.417648 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-298917f0-26b0-4d60-bf62-3f7c17a51e6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.410154 May 26 17:00:09.419185 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 151/280] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:09 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:10.060081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-91ef739e-3d5c-4d2f-93c2-d8d4e527cadf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:10.061055 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-91ef739e-3d5c-4d2f-93c2-d8d4e527cadf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:10.090033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91ef739e-3d5c-4d2f-93c2-d8d4e527cadf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:10.095178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91ef739e-3d5c-4d2f-93c2-d8d4e527cadf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:10.097919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91ef739e-3d5c-4d2f-93c2-d8d4e527cadf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:10.098679 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91ef739e-3d5c-4d2f-93c2-d8d4e527cadf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:10.350190 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-91ef739e-3d5c-4d2f-93c2-d8d4e527cadf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:10.369065 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-91ef739e-3d5c-4d2f-93c2-d8d4e527cadf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1257 microversion: 2.1 time: 0.320879 May 26 17:00:10.374966 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 130/281] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:10 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1257 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:10.436561 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e6673a0c-851e-40e7-9f13-eb939c131285 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:10.438060 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e6673a0c-851e-40e7-9f13-eb939c131285 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:10.449217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e6673a0c-851e-40e7-9f13-eb939c131285 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:10.449781 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e6673a0c-851e-40e7-9f13-eb939c131285 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:10.451082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e6673a0c-851e-40e7-9f13-eb939c131285 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:10.452210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e6673a0c-851e-40e7-9f13-eb939c131285 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:10.911466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e6673a0c-851e-40e7-9f13-eb939c131285 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:10.919168 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e6673a0c-851e-40e7-9f13-eb939c131285 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.487680 May 26 17:00:10.919736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 152/282] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:10 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:11.385957 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d9151945-133d-44f7-a696-3017b49e2524 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:11.387309 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d9151945-133d-44f7-a696-3017b49e2524 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:11.394730 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d9151945-133d-44f7-a696-3017b49e2524 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:11.395162 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d9151945-133d-44f7-a696-3017b49e2524 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:11.396218 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d9151945-133d-44f7-a696-3017b49e2524 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:11.396859 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d9151945-133d-44f7-a696-3017b49e2524 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:11.468881 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d9151945-133d-44f7-a696-3017b49e2524 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:11.497591 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d9151945-133d-44f7-a696-3017b49e2524 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1313 microversion: 2.1 time: 0.115353 May 26 17:00:11.498443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 131/283] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:11 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1313 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:11.937207 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a9b5cdd6-209f-42dc-8412-e80a0d58b4b3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:11.937819 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a9b5cdd6-209f-42dc-8412-e80a0d58b4b3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:11.946545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a9b5cdd6-209f-42dc-8412-e80a0d58b4b3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:11.947009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a9b5cdd6-209f-42dc-8412-e80a0d58b4b3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:11.947895 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a9b5cdd6-209f-42dc-8412-e80a0d58b4b3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:11.948335 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a9b5cdd6-209f-42dc-8412-e80a0d58b4b3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.212658 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a9b5cdd6-209f-42dc-8412-e80a0d58b4b3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:12.223710 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a9b5cdd6-209f-42dc-8412-e80a0d58b4b3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.290388 May 26 17:00:12.227343 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 153/284] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:11 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:12.518708 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c34e4b17-4f8a-46ad-9457-edc4e25114e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:12.519319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c34e4b17-4f8a-46ad-9457-edc4e25114e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:12.533165 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c34e4b17-4f8a-46ad-9457-edc4e25114e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.538500 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c34e4b17-4f8a-46ad-9457-edc4e25114e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.538500 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c34e4b17-4f8a-46ad-9457-edc4e25114e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.538500 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c34e4b17-4f8a-46ad-9457-edc4e25114e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.648598 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c34e4b17-4f8a-46ad-9457-edc4e25114e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:12.656362 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c34e4b17-4f8a-46ad-9457-edc4e25114e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1313 microversion: 2.1 time: 0.142740 May 26 17:00:12.657160 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 132/285] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:12 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:13.248331 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6be49870-07f7-4651-a735-2a8bb85904fa tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:13.248984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6be49870-07f7-4651-a735-2a8bb85904fa tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:13.263818 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6be49870-07f7-4651-a735-2a8bb85904fa tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:13.264448 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6be49870-07f7-4651-a735-2a8bb85904fa tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:13.265758 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6be49870-07f7-4651-a735-2a8bb85904fa tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:13.266229 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6be49870-07f7-4651-a735-2a8bb85904fa tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:13.492768 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6be49870-07f7-4651-a735-2a8bb85904fa tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:13.501698 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6be49870-07f7-4651-a735-2a8bb85904fa tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.258433 May 26 17:00:13.502553 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 154/286] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:13 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:13.673135 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b496b0e9-679e-448d-80b7-b74dbe4eec66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:13.673915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b496b0e9-679e-448d-80b7-b74dbe4eec66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:13.682475 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b496b0e9-679e-448d-80b7-b74dbe4eec66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:13.685022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b496b0e9-679e-448d-80b7-b74dbe4eec66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:13.685022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b496b0e9-679e-448d-80b7-b74dbe4eec66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:13.685022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b496b0e9-679e-448d-80b7-b74dbe4eec66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:13.795250 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b496b0e9-679e-448d-80b7-b74dbe4eec66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:13.806423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b496b0e9-679e-448d-80b7-b74dbe4eec66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1313 microversion: 2.1 time: 0.136748 May 26 17:00:13.807443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 133/287] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:13 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:14.405833 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-830bb33e-0d58-4da3-b628-d69289d2d9dd tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Action: 'create', calling method: .version_select at 0x7fd2525428b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2141156347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhpBH28Hh9QJlFcqvf3HpILn/qT3kwVQbbIC9xRM4KtGv+nz8fPe1eW4kjBxIlBMtMQBxeOgcFVj0kcUxTSB+mNsfCFL86S2ynSBVPF3CE1icOFAug2ms92gBjHfaWU9g=="}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:14.419549 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-830bb33e-0d58-4da3-b628-d69289d2d9dd tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Getting quotas for project ed4f536fcafe46b5ae159b93acb7e041. Resources: {'key_pairs'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:00:14.423631 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-830bb33e-0d58-4da3-b628-d69289d2d9dd tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Getting quotas for user 530b2b1951644755afd1432381cf37f9 and project ed4f536fcafe46b5ae159b93acb7e041. Resources: {'key_pairs'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:00:14.519171 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-35850672-d546-43c0-9103-bbb401e8f207 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:14.519788 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-35850672-d546-43c0-9103-bbb401e8f207 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:14.525918 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-35850672-d546-43c0-9103-bbb401e8f207 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.526397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-35850672-d546-43c0-9103-bbb401e8f207 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.527224 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-35850672-d546-43c0-9103-bbb401e8f207 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.527603 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-35850672-d546-43c0-9103-bbb401e8f207 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.539993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-830bb33e-0d58-4da3-b628-d69289d2d9dd tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.411489 May 26 17:00:14.540869 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 155/288] 10.222.0.112 () {60 vars in 1163 bytes} [Thu May 26 17:00:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:14.663266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-35850672-d546-43c0-9103-bbb401e8f207 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:14.673166 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-35850672-d546-43c0-9103-bbb401e8f207 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.158717 May 26 17:00:14.682312 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 134/289] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:14 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:14.824265 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3c5c89cb-c642-4204-94c9-d47fd2b652d8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:14.824831 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3c5c89cb-c642-4204-94c9-d47fd2b652d8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:14.831731 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3c5c89cb-c642-4204-94c9-d47fd2b652d8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.832446 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3c5c89cb-c642-4204-94c9-d47fd2b652d8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.833251 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3c5c89cb-c642-4204-94c9-d47fd2b652d8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.833689 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3c5c89cb-c642-4204-94c9-d47fd2b652d8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.910514 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3c5c89cb-c642-4204-94c9-d47fd2b652d8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:14.918137 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3c5c89cb-c642-4204-94c9-d47fd2b652d8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1313 microversion: 2.1 time: 0.097878 May 26 17:00:14.918740 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 156/290] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:14 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1313 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:15.689712 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-231c44b2-dc46-499a-9a25-d11d256b343c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:15.690518 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-231c44b2-dc46-499a-9a25-d11d256b343c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:15.701015 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-231c44b2-dc46-499a-9a25-d11d256b343c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:15.701015 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-231c44b2-dc46-499a-9a25-d11d256b343c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:15.701015 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-231c44b2-dc46-499a-9a25-d11d256b343c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:15.701015 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-231c44b2-dc46-499a-9a25-d11d256b343c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:15.937064 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8ef0c4dd-6b8a-4519-95d7-4d2ea9a71145 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:15.937813 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8ef0c4dd-6b8a-4519-95d7-4d2ea9a71145 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:15.944367 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8ef0c4dd-6b8a-4519-95d7-4d2ea9a71145 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:15.945904 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8ef0c4dd-6b8a-4519-95d7-4d2ea9a71145 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:15.947122 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8ef0c4dd-6b8a-4519-95d7-4d2ea9a71145 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:15.947745 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8ef0c4dd-6b8a-4519-95d7-4d2ea9a71145 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:16.015934 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8ef0c4dd-6b8a-4519-95d7-4d2ea9a71145 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:16.025130 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8ef0c4dd-6b8a-4519-95d7-4d2ea9a71145 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1313 microversion: 2.1 time: 0.091473 May 26 17:00:16.025130 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 157/291] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:15 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1313 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:16.053980 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-231c44b2-dc46-499a-9a25-d11d256b343c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:16.067542 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-231c44b2-dc46-499a-9a25-d11d256b343c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.381979 May 26 17:00:16.070736 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 135/292] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:15 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:17.042652 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-77ca0242-ab25-4c40-9d9f-503c12be76cf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:17.043263 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-77ca0242-ab25-4c40-9d9f-503c12be76cf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:17.049504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:17.057315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-77ca0242-ab25-4c40-9d9f-503c12be76cf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.057766 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-77ca0242-ab25-4c40-9d9f-503c12be76cf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.058582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-77ca0242-ab25-4c40-9d9f-503c12be76cf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.059351 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-77ca0242-ab25-4c40-9d9f-503c12be76cf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.092972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4be3f768-def4-4f69-a234-156829b6440b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:17.095237 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4be3f768-def4-4f69-a234-156829b6440b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:17.106396 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:17.113309 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4be3f768-def4-4f69-a234-156829b6440b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.113775 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4be3f768-def4-4f69-a234-156829b6440b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.114608 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4be3f768-def4-4f69-a234-156829b6440b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.115043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4be3f768-def4-4f69-a234-156829b6440b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.124715 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=91 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:17.171272 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-77ca0242-ab25-4c40-9d9f-503c12be76cf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:17.179132 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-77ca0242-ab25-4c40-9d9f-503c12be76cf tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1313 microversion: 2.1 time: 0.142072 May 26 17:00:17.179788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 158/293] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:17 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:17.267258 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4be3f768-def4-4f69-a234-156829b6440b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:17.275895 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4be3f768-def4-4f69-a234-156829b6440b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.194751 May 26 17:00:17.276814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 136/294] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:17 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:17.305454 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-353ceb08-b64c-415a-b2a0-1b9ad30d1a63 req-f0cdbd3d-c673-4ed4-a204-42498c81fb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc8354d-7f45-4c4a-a590-aeadaad33115", "name": "network-vif-plugged", "status": "completed", "tag": "ceb32ccc-6e72-46ab-9bdd-73afcc5aa54c"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:17.321205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-353ceb08-b64c-415a-b2a0-1b9ad30d1a63 req-f0cdbd3d-c673-4ed4-a204-42498c81fb43 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.321650 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-353ceb08-b64c-415a-b2a0-1b9ad30d1a63 req-f0cdbd3d-c673-4ed4-a204-42498c81fb43 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.346524 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-353ceb08-b64c-415a-b2a0-1b9ad30d1a63 req-f0cdbd3d-c673-4ed4-a204-42498c81fb43 service nova] Creating event network-vif-plugged:ceb32ccc-6e72-46ab-9bdd-73afcc5aa54c for instance dfc8354d-7f45-4c4a-a590-aeadaad33115 on hv-cinder-83607 May 26 17:00:17.355378 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-353ceb08-b64c-415a-b2a0-1b9ad30d1a63 req-f0cdbd3d-c673-4ed4-a204-42498c81fb43 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053490 May 26 17:00:17.356600 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 159/295] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:18.205290 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7be14d5e-a32a-49a2-afcd-6da0d28ff649 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:18.211139 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7be14d5e-a32a-49a2-afcd-6da0d28ff649 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:18.219702 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=6 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:18.222175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7be14d5e-a32a-49a2-afcd-6da0d28ff649 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:18.222730 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7be14d5e-a32a-49a2-afcd-6da0d28ff649 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:18.223501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7be14d5e-a32a-49a2-afcd-6da0d28ff649 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:18.223929 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7be14d5e-a32a-49a2-afcd-6da0d28ff649 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:18.297520 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ede08b56-d76e-434d-bf80-cad17893d0c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:18.298845 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ede08b56-d76e-434d-bf80-cad17893d0c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:18.307697 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ede08b56-d76e-434d-bf80-cad17893d0c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:18.308356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ede08b56-d76e-434d-bf80-cad17893d0c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:18.309374 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ede08b56-d76e-434d-bf80-cad17893d0c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:18.309997 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ede08b56-d76e-434d-bf80-cad17893d0c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:18.393174 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7be14d5e-a32a-49a2-afcd-6da0d28ff649 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:18.399364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7be14d5e-a32a-49a2-afcd-6da0d28ff649 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1321 microversion: 2.1 time: 0.199792 May 26 17:00:18.400988 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 137/296] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:18 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:18.526979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ede08b56-d76e-434d-bf80-cad17893d0c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:18.535814 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ede08b56-d76e-434d-bf80-cad17893d0c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.243703 May 26 17:00:18.538383 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 160/297] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:18 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:19.417895 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-815b0623-4664-4796-9016-d2c7ccc742c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:19.418534 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-815b0623-4664-4796-9016-d2c7ccc742c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:19.426113 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-815b0623-4664-4796-9016-d2c7ccc742c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:19.426581 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-815b0623-4664-4796-9016-d2c7ccc742c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:19.427340 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-815b0623-4664-4796-9016-d2c7ccc742c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:19.427774 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-815b0623-4664-4796-9016-d2c7ccc742c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:19.556153 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-622e3656-c967-4450-a508-badf0e8f3060 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:19.557219 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-622e3656-c967-4450-a508-badf0e8f3060 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:19.560772 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-815b0623-4664-4796-9016-d2c7ccc742c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:19.564983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-622e3656-c967-4450-a508-badf0e8f3060 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:19.565432 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-622e3656-c967-4450-a508-badf0e8f3060 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:19.566198 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-622e3656-c967-4450-a508-badf0e8f3060 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:19.566665 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-622e3656-c967-4450-a508-badf0e8f3060 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:19.568452 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-815b0623-4664-4796-9016-d2c7ccc742c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.155124 May 26 17:00:19.569035 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 138/298] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:19 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:19.703682 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-622e3656-c967-4450-a508-badf0e8f3060 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:19.711720 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-622e3656-c967-4450-a508-badf0e8f3060 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.161004 May 26 17:00:19.712306 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 161/299] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:19 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:20.586302 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-28e972b5-e404-421e-9176-2029e668b7f4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:20.586872 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-28e972b5-e404-421e-9176-2029e668b7f4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:20.593592 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-28e972b5-e404-421e-9176-2029e668b7f4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:20.594045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-28e972b5-e404-421e-9176-2029e668b7f4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.594856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-28e972b5-e404-421e-9176-2029e668b7f4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:20.595297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-28e972b5-e404-421e-9176-2029e668b7f4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.728117 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7a7cc310-2151-4841-a2b7-133426ed61a3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:20.728732 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7a7cc310-2151-4841-a2b7-133426ed61a3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:20.728867 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-28e972b5-e404-421e-9176-2029e668b7f4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:20.734943 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a7cc310-2151-4841-a2b7-133426ed61a3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:20.735392 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a7cc310-2151-4841-a2b7-133426ed61a3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.736238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a7cc310-2151-4841-a2b7-133426ed61a3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:20.736655 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a7cc310-2151-4841-a2b7-133426ed61a3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.740704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:20.752592 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-28e972b5-e404-421e-9176-2029e668b7f4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.170250 May 26 17:00:20.753172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 139/300] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:20 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:20.868017 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7a7cc310-2151-4841-a2b7-133426ed61a3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:20.875677 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7a7cc310-2151-4841-a2b7-133426ed61a3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.151420 May 26 17:00:20.876414 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 162/301] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:20 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:21.769782 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d6a6c6c0-55b0-4be1-96f4-d23128315779 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:21.770421 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d6a6c6c0-55b0-4be1-96f4-d23128315779 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:21.776912 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d6a6c6c0-55b0-4be1-96f4-d23128315779 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:21.777352 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d6a6c6c0-55b0-4be1-96f4-d23128315779 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:21.778109 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d6a6c6c0-55b0-4be1-96f4-d23128315779 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:21.778565 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d6a6c6c0-55b0-4be1-96f4-d23128315779 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:21.891758 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d7412bcc-df95-4b48-959e-2426c3f796eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:21.892347 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d7412bcc-df95-4b48-959e-2426c3f796eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:21.894208 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:21.899120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d7412bcc-df95-4b48-959e-2426c3f796eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:21.899570 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d7412bcc-df95-4b48-959e-2426c3f796eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:21.900343 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d7412bcc-df95-4b48-959e-2426c3f796eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:21.900780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d7412bcc-df95-4b48-959e-2426c3f796eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:21.907727 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d6a6c6c0-55b0-4be1-96f4-d23128315779 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:21.915068 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d6a6c6c0-55b0-4be1-96f4-d23128315779 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.149139 May 26 17:00:21.915675 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 140/302] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:21 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:22.039469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d7412bcc-df95-4b48-959e-2426c3f796eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:22.048034 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d7412bcc-df95-4b48-959e-2426c3f796eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.160213 May 26 17:00:22.048604 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 163/303] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:21 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:22.931816 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d6fc01c2-fdc6-49b6-bee8-718a32bef316 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:22.932415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d6fc01c2-fdc6-49b6-bee8-718a32bef316 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:22.939220 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d6fc01c2-fdc6-49b6-bee8-718a32bef316 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:22.939668 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d6fc01c2-fdc6-49b6-bee8-718a32bef316 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:22.940525 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d6fc01c2-fdc6-49b6-bee8-718a32bef316 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:22.941075 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d6fc01c2-fdc6-49b6-bee8-718a32bef316 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:23.064676 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b4929a50-c6d1-4bfe-8bfd-c9a821cc08a9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:23.065288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b4929a50-c6d1-4bfe-8bfd-c9a821cc08a9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:23.071520 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b4929a50-c6d1-4bfe-8bfd-c9a821cc08a9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:23.071982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b4929a50-c6d1-4bfe-8bfd-c9a821cc08a9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:23.072765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b4929a50-c6d1-4bfe-8bfd-c9a821cc08a9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:23.073207 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b4929a50-c6d1-4bfe-8bfd-c9a821cc08a9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:23.074391 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d6fc01c2-fdc6-49b6-bee8-718a32bef316 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:23.081817 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d6fc01c2-fdc6-49b6-bee8-718a32bef316 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.153825 May 26 17:00:23.082830 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 141/304] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:22 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:23.206087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b4929a50-c6d1-4bfe-8bfd-c9a821cc08a9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:23.214125 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b4929a50-c6d1-4bfe-8bfd-c9a821cc08a9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.153383 May 26 17:00:23.214734 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 164/305] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:23 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:24.104941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-38238a64-b04d-404c-bb55-656ffe79ca2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:24.106373 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-38238a64-b04d-404c-bb55-656ffe79ca2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:24.120167 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-38238a64-b04d-404c-bb55-656ffe79ca2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:24.126031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-38238a64-b04d-404c-bb55-656ffe79ca2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:24.126031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-38238a64-b04d-404c-bb55-656ffe79ca2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:24.126031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-38238a64-b04d-404c-bb55-656ffe79ca2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:24.231899 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1f0d3fb3-d06e-4f02-8321-6a4e5d29fd35 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:24.232837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1f0d3fb3-d06e-4f02-8321-6a4e5d29fd35 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:24.246627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1f0d3fb3-d06e-4f02-8321-6a4e5d29fd35 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:24.247082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1f0d3fb3-d06e-4f02-8321-6a4e5d29fd35 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:24.248566 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1f0d3fb3-d06e-4f02-8321-6a4e5d29fd35 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:24.249303 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1f0d3fb3-d06e-4f02-8321-6a4e5d29fd35 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:24.371721 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-38238a64-b04d-404c-bb55-656ffe79ca2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:24.380567 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-38238a64-b04d-404c-bb55-656ffe79ca2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.285296 May 26 17:00:24.385817 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 142/306] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:24 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:24.408799 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1f0d3fb3-d06e-4f02-8321-6a4e5d29fd35 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:24.416341 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1f0d3fb3-d06e-4f02-8321-6a4e5d29fd35 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.188586 May 26 17:00:24.416998 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 165/307] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:24 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:24.533530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-fc89bf3d-04a7-433c-9c6b-61946d6d0a17 req-fc54691c-3362-4b90-9f8c-ec6b6ac4990e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d526ee14-28c1-46f0-97e9-37aecfc19059", "tag": "8f683af9-2af5-45b8-b6cb-ef44b939789d"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:24.542052 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-fc89bf3d-04a7-433c-9c6b-61946d6d0a17 req-fc54691c-3362-4b90-9f8c-ec6b6ac4990e service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:24.542746 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-fc89bf3d-04a7-433c-9c6b-61946d6d0a17 req-fc54691c-3362-4b90-9f8c-ec6b6ac4990e service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:24.557484 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-fc89bf3d-04a7-433c-9c6b-61946d6d0a17 req-fc54691c-3362-4b90-9f8c-ec6b6ac4990e service nova] Creating event network-changed:8f683af9-2af5-45b8-b6cb-ef44b939789d for instance d526ee14-28c1-46f0-97e9-37aecfc19059 on hv-cinder-83607 May 26 17:00:24.560317 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-fc89bf3d-04a7-433c-9c6b-61946d6d0a17 req-fc54691c-3362-4b90-9f8c-ec6b6ac4990e service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031367 May 26 17:00:24.561580 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 143/308] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:25.401358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ba92174f-0560-400a-a187-6de50b975895 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:25.402280 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ba92174f-0560-400a-a187-6de50b975895 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:25.406141 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=12 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:25.409882 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba92174f-0560-400a-a187-6de50b975895 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:25.410617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba92174f-0560-400a-a187-6de50b975895 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:25.411620 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba92174f-0560-400a-a187-6de50b975895 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:25.412139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba92174f-0560-400a-a187-6de50b975895 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:25.440549 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-60e18324-51aa-41f6-9d99-d391dc1eea50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:25.441341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-60e18324-51aa-41f6-9d99-d391dc1eea50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:25.450835 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-60e18324-51aa-41f6-9d99-d391dc1eea50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:25.453584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-60e18324-51aa-41f6-9d99-d391dc1eea50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:25.459980 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-60e18324-51aa-41f6-9d99-d391dc1eea50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:25.460917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-60e18324-51aa-41f6-9d99-d391dc1eea50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:25.593287 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ba92174f-0560-400a-a187-6de50b975895 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:25.609552 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ba92174f-0560-400a-a187-6de50b975895 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.211973 May 26 17:00:25.618858 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 166/309] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:25 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:25.670788 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-60e18324-51aa-41f6-9d99-d391dc1eea50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:25.678973 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-60e18324-51aa-41f6-9d99-d391dc1eea50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.243292 May 26 17:00:25.689656 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 144/310] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:25 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:26.637135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4db6b434-e6bb-4860-b81c-5f29abc97bc8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:26.637135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4db6b434-e6bb-4860-b81c-5f29abc97bc8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:26.637135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4db6b434-e6bb-4860-b81c-5f29abc97bc8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.637135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4db6b434-e6bb-4860-b81c-5f29abc97bc8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.637932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4db6b434-e6bb-4860-b81c-5f29abc97bc8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.637932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4db6b434-e6bb-4860-b81c-5f29abc97bc8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.697178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e59e8cf8-f83f-44f9-8a23-9edca3b683d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:26.697986 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e59e8cf8-f83f-44f9-8a23-9edca3b683d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:26.705597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e59e8cf8-f83f-44f9-8a23-9edca3b683d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.706079 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e59e8cf8-f83f-44f9-8a23-9edca3b683d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.706899 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e59e8cf8-f83f-44f9-8a23-9edca3b683d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.707704 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e59e8cf8-f83f-44f9-8a23-9edca3b683d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.772762 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4db6b434-e6bb-4860-b81c-5f29abc97bc8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:26.780814 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4db6b434-e6bb-4860-b81c-5f29abc97bc8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.158150 May 26 17:00:26.781402 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 167/311] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:26 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:26.846016 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e59e8cf8-f83f-44f9-8a23-9edca3b683d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:26.855105 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e59e8cf8-f83f-44f9-8a23-9edca3b683d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.161682 May 26 17:00:26.855900 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 145/312] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:26 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:27.798167 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d6669dc1-922d-43cf-9f87-f54676aa3d2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:27.798823 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d6669dc1-922d-43cf-9f87-f54676aa3d2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:27.805361 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d6669dc1-922d-43cf-9f87-f54676aa3d2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:27.805896 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d6669dc1-922d-43cf-9f87-f54676aa3d2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:27.806716 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d6669dc1-922d-43cf-9f87-f54676aa3d2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:27.807154 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d6669dc1-922d-43cf-9f87-f54676aa3d2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:27.872464 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a774ed49-114c-4a59-b8e2-69aa4086a2cc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:27.873817 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a774ed49-114c-4a59-b8e2-69aa4086a2cc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:27.880590 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a774ed49-114c-4a59-b8e2-69aa4086a2cc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:27.881147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a774ed49-114c-4a59-b8e2-69aa4086a2cc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:27.881843 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a774ed49-114c-4a59-b8e2-69aa4086a2cc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:27.882434 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a774ed49-114c-4a59-b8e2-69aa4086a2cc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:27.962563 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d6669dc1-922d-43cf-9f87-f54676aa3d2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:27.970487 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d6669dc1-922d-43cf-9f87-f54676aa3d2d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.177171 May 26 17:00:27.971062 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 168/313] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:27 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:28.065191 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a774ed49-114c-4a59-b8e2-69aa4086a2cc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:28.073531 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a774ed49-114c-4a59-b8e2-69aa4086a2cc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.204731 May 26 17:00:28.074297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 146/314] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:27 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:28.987303 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9c53cfde-7314-420a-8bad-9534c8c6386e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:28.987907 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9c53cfde-7314-420a-8bad-9534c8c6386e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:28.993965 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9c53cfde-7314-420a-8bad-9534c8c6386e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:28.994449 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9c53cfde-7314-420a-8bad-9534c8c6386e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:28.995214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9c53cfde-7314-420a-8bad-9534c8c6386e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:29.006874 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9c53cfde-7314-420a-8bad-9534c8c6386e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:29.093132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4054f91f-deed-47ae-b7fc-38c6a0e73af4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:29.094418 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4054f91f-deed-47ae-b7fc-38c6a0e73af4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:29.101238 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4054f91f-deed-47ae-b7fc-38c6a0e73af4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:29.101938 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4054f91f-deed-47ae-b7fc-38c6a0e73af4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:29.103026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4054f91f-deed-47ae-b7fc-38c6a0e73af4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:29.103623 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4054f91f-deed-47ae-b7fc-38c6a0e73af4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:29.148844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9c53cfde-7314-420a-8bad-9534c8c6386e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:29.163003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9c53cfde-7314-420a-8bad-9534c8c6386e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.179458 May 26 17:00:29.163684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 169/315] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:28 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:29.247140 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4054f91f-deed-47ae-b7fc-38c6a0e73af4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:29.256154 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4054f91f-deed-47ae-b7fc-38c6a0e73af4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.168224 May 26 17:00:29.256731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 147/316] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:29 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:30.181185 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d181e7d8-d72b-4620-ac34-46739649eddb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:30.181832 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d181e7d8-d72b-4620-ac34-46739649eddb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:30.188699 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d181e7d8-d72b-4620-ac34-46739649eddb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:30.189074 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d181e7d8-d72b-4620-ac34-46739649eddb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:30.189871 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d181e7d8-d72b-4620-ac34-46739649eddb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:30.190311 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d181e7d8-d72b-4620-ac34-46739649eddb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:30.272755 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6832590c-0236-4c09-acb4-3910cb4592d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:30.274166 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6832590c-0236-4c09-acb4-3910cb4592d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:30.281403 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6832590c-0236-4c09-acb4-3910cb4592d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:30.281854 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6832590c-0236-4c09-acb4-3910cb4592d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:30.282656 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6832590c-0236-4c09-acb4-3910cb4592d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:30.283090 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6832590c-0236-4c09-acb4-3910cb4592d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:30.334213 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d181e7d8-d72b-4620-ac34-46739649eddb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:30.343080 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d181e7d8-d72b-4620-ac34-46739649eddb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.166159 May 26 17:00:30.343666 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 170/317] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:30 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:30.421880 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6832590c-0236-4c09-acb4-3910cb4592d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:30.429205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6832590c-0236-4c09-acb4-3910cb4592d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.160421 May 26 17:00:30.429777 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 148/318] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:30 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:31.360461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dceaa1e8-b66c-4bab-a9b5-5a0a9d8fa4b5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:31.361071 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-dceaa1e8-b66c-4bab-a9b5-5a0a9d8fa4b5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:31.367034 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dceaa1e8-b66c-4bab-a9b5-5a0a9d8fa4b5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:31.367483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dceaa1e8-b66c-4bab-a9b5-5a0a9d8fa4b5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.368247 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dceaa1e8-b66c-4bab-a9b5-5a0a9d8fa4b5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:31.368674 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dceaa1e8-b66c-4bab-a9b5-5a0a9d8fa4b5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.445685 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8a1436c2-9e73-49de-b1b8-5df7cc3f9bcb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:31.446286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8a1436c2-9e73-49de-b1b8-5df7cc3f9bcb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:31.453265 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8a1436c2-9e73-49de-b1b8-5df7cc3f9bcb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:31.453901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8a1436c2-9e73-49de-b1b8-5df7cc3f9bcb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.454846 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8a1436c2-9e73-49de-b1b8-5df7cc3f9bcb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:31.455426 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8a1436c2-9e73-49de-b1b8-5df7cc3f9bcb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.506932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dceaa1e8-b66c-4bab-a9b5-5a0a9d8fa4b5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:31.515229 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-dceaa1e8-b66c-4bab-a9b5-5a0a9d8fa4b5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.159089 May 26 17:00:31.515811 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 171/319] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:31 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:31.602844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8a1436c2-9e73-49de-b1b8-5df7cc3f9bcb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:31.611316 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8a1436c2-9e73-49de-b1b8-5df7cc3f9bcb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.169321 May 26 17:00:31.612284 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 149/320] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:31 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:32.533355 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e8109396-8a36-4b12-9978-39965f5858fd tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:32.533952 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e8109396-8a36-4b12-9978-39965f5858fd tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:32.540390 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8109396-8a36-4b12-9978-39965f5858fd tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:32.540852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8109396-8a36-4b12-9978-39965f5858fd tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:32.541618 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8109396-8a36-4b12-9978-39965f5858fd tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:32.542273 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8109396-8a36-4b12-9978-39965f5858fd tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:32.628008 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-29cf32c4-cb5d-48c3-9afe-ff835f6ad873 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:32.628722 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-29cf32c4-cb5d-48c3-9afe-ff835f6ad873 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:32.635873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-29cf32c4-cb5d-48c3-9afe-ff835f6ad873 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:32.636342 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-29cf32c4-cb5d-48c3-9afe-ff835f6ad873 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:32.637111 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-29cf32c4-cb5d-48c3-9afe-ff835f6ad873 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:32.637541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-29cf32c4-cb5d-48c3-9afe-ff835f6ad873 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:32.686821 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e8109396-8a36-4b12-9978-39965f5858fd tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:32.689388 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e8109396-8a36-4b12-9978-39965f5858fd tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.160516 May 26 17:00:32.689958 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 172/321] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:32 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:32.789379 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-29cf32c4-cb5d-48c3-9afe-ff835f6ad873 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:32.798502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-29cf32c4-cb5d-48c3-9afe-ff835f6ad873 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.174860 May 26 17:00:32.799755 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 150/322] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:32 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:33.707707 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-27511b98-4c92-42d6-85a2-f291f355079c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:34.033226 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-27511b98-4c92-42d6-85a2-f291f355079c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:34.033226 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-27511b98-4c92-42d6-85a2-f291f355079c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:34.033226 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-27511b98-4c92-42d6-85a2-f291f355079c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:34.033226 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-27511b98-4c92-42d6-85a2-f291f355079c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:34.034362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-27511b98-4c92-42d6-85a2-f291f355079c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:34.035138 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-440c284e-0402-4af5-9505-fa79c1beee61 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:34.035138 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-440c284e-0402-4af5-9505-fa79c1beee61 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:34.035138 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-440c284e-0402-4af5-9505-fa79c1beee61 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:34.035138 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-440c284e-0402-4af5-9505-fa79c1beee61 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:34.035804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-440c284e-0402-4af5-9505-fa79c1beee61 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:34.035804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-440c284e-0402-4af5-9505-fa79c1beee61 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:34.035984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-27511b98-4c92-42d6-85a2-f291f355079c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:34.035984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-27511b98-4c92-42d6-85a2-f291f355079c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.159756 May 26 17:00:34.035984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 173/323] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:33 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:34.036276 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-440c284e-0402-4af5-9505-fa79c1beee61 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:34.036276 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-440c284e-0402-4af5-9505-fa79c1beee61 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.164719 May 26 17:00:34.036276 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 151/324] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:33 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:34.880419 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ab32c5b3-bd49-4332-8419-2021a3f2abbe tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:34.881168 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ab32c5b3-bd49-4332-8419-2021a3f2abbe tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:34.888025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ab32c5b3-bd49-4332-8419-2021a3f2abbe tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:34.889220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ab32c5b3-bd49-4332-8419-2021a3f2abbe tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:34.889922 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ab32c5b3-bd49-4332-8419-2021a3f2abbe tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:34.890387 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ab32c5b3-bd49-4332-8419-2021a3f2abbe tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:34.992980 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-48626ffb-a463-473b-ab78-930bd29a3de5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:34.993708 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-48626ffb-a463-473b-ab78-930bd29a3de5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:35.000567 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-48626ffb-a463-473b-ab78-930bd29a3de5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:35.001092 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-48626ffb-a463-473b-ab78-930bd29a3de5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:35.001958 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-48626ffb-a463-473b-ab78-930bd29a3de5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:35.002424 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-48626ffb-a463-473b-ab78-930bd29a3de5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:35.030410 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ab32c5b3-bd49-4332-8419-2021a3f2abbe tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:35.038867 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ab32c5b3-bd49-4332-8419-2021a3f2abbe tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.162448 May 26 17:00:35.039725 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 174/325] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:34 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:35.159000 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-48626ffb-a463-473b-ab78-930bd29a3de5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:35.166244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-48626ffb-a463-473b-ab78-930bd29a3de5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.177101 May 26 17:00:35.166846 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 152/326] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:34 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:36.056107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f8ca16c6-3708-4bf7-ab3d-0922fa5931f6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:36.056724 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f8ca16c6-3708-4bf7-ab3d-0922fa5931f6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:36.064796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f8ca16c6-3708-4bf7-ab3d-0922fa5931f6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:36.065390 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f8ca16c6-3708-4bf7-ab3d-0922fa5931f6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:36.066538 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f8ca16c6-3708-4bf7-ab3d-0922fa5931f6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:36.067157 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f8ca16c6-3708-4bf7-ab3d-0922fa5931f6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:36.183250 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c411eb7d-8bec-4e9d-b581-76524e822dcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:36.183866 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c411eb7d-8bec-4e9d-b581-76524e822dcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:36.191388 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c411eb7d-8bec-4e9d-b581-76524e822dcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:36.191833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c411eb7d-8bec-4e9d-b581-76524e822dcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:36.192754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c411eb7d-8bec-4e9d-b581-76524e822dcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:36.193183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c411eb7d-8bec-4e9d-b581-76524e822dcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:36.212034 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f8ca16c6-3708-4bf7-ab3d-0922fa5931f6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:36.220062 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f8ca16c6-3708-4bf7-ab3d-0922fa5931f6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.167736 May 26 17:00:36.221083 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 175/327] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:36 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:36.234528 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:36.352235 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c411eb7d-8bec-4e9d-b581-76524e822dcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:36.361263 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c411eb7d-8bec-4e9d-b581-76524e822dcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.181730 May 26 17:00:36.362117 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 153/328] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:36 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:37.238867 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-fd8d011c-0c70-47e4-86fb-fa62e4b286e2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:37.239541 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-fd8d011c-0c70-47e4-86fb-fa62e4b286e2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:37.245667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fd8d011c-0c70-47e4-86fb-fa62e4b286e2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.246115 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fd8d011c-0c70-47e4-86fb-fa62e4b286e2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:37.246916 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fd8d011c-0c70-47e4-86fb-fa62e4b286e2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.247346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fd8d011c-0c70-47e4-86fb-fa62e4b286e2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:37.379235 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-33422f4b-bec5-46f2-9b62-426fb2f5b280 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:37.380588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-33422f4b-bec5-46f2-9b62-426fb2f5b280 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:37.387436 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-33422f4b-bec5-46f2-9b62-426fb2f5b280 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.388030 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-33422f4b-bec5-46f2-9b62-426fb2f5b280 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:37.389342 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-33422f4b-bec5-46f2-9b62-426fb2f5b280 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.389996 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-33422f4b-bec5-46f2-9b62-426fb2f5b280 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:37.392952 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fd8d011c-0c70-47e4-86fb-fa62e4b286e2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:37.421514 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-fd8d011c-0c70-47e4-86fb-fa62e4b286e2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.186331 May 26 17:00:37.424701 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 176/329] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:37 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:37.549025 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-33422f4b-bec5-46f2-9b62-426fb2f5b280 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:37.556534 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-33422f4b-bec5-46f2-9b62-426fb2f5b280 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.181134 May 26 17:00:37.557282 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 154/330] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:37 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:38.439214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5f884694-e173-4df5-b703-67ebf41ce5c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:38.439851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5f884694-e173-4df5-b703-67ebf41ce5c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:38.445735 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5f884694-e173-4df5-b703-67ebf41ce5c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:38.446187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5f884694-e173-4df5-b703-67ebf41ce5c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:38.446991 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5f884694-e173-4df5-b703-67ebf41ce5c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:38.447431 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5f884694-e173-4df5-b703-67ebf41ce5c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:38.573399 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3d6de080-0586-4eb1-9886-32db7479b720 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:38.574020 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3d6de080-0586-4eb1-9886-32db7479b720 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:38.579078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5f884694-e173-4df5-b703-67ebf41ce5c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:38.580595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3d6de080-0586-4eb1-9886-32db7479b720 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:38.581050 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3d6de080-0586-4eb1-9886-32db7479b720 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:38.581829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3d6de080-0586-4eb1-9886-32db7479b720 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:38.582540 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3d6de080-0586-4eb1-9886-32db7479b720 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:38.588889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5f884694-e173-4df5-b703-67ebf41ce5c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.153992 May 26 17:00:38.589652 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 177/331] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:38 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:38.721509 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3d6de080-0586-4eb1-9886-32db7479b720 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:38.728888 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3d6de080-0586-4eb1-9886-32db7479b720 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.159511 May 26 17:00:38.729444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 155/332] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:38 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:39.606847 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a46f4ade-ba9e-4d41-8b0f-0b058c61b06e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:39.608014 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a46f4ade-ba9e-4d41-8b0f-0b058c61b06e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:39.614060 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a46f4ade-ba9e-4d41-8b0f-0b058c61b06e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:39.614547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a46f4ade-ba9e-4d41-8b0f-0b058c61b06e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:39.615296 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a46f4ade-ba9e-4d41-8b0f-0b058c61b06e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:39.615729 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a46f4ade-ba9e-4d41-8b0f-0b058c61b06e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:39.743037 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a46f4ade-ba9e-4d41-8b0f-0b058c61b06e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:39.744906 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-af689031-86ac-4d04-a6d0-d5cc2f8b4522 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:39.745524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-af689031-86ac-4d04-a6d0-d5cc2f8b4522 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:39.746424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:39.750828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a46f4ade-ba9e-4d41-8b0f-0b058c61b06e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.147812 May 26 17:00:39.751402 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 178/333] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:39 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:39.752254 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-af689031-86ac-4d04-a6d0-d5cc2f8b4522 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:39.752709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-af689031-86ac-4d04-a6d0-d5cc2f8b4522 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:39.753473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-af689031-86ac-4d04-a6d0-d5cc2f8b4522 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:39.753967 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-af689031-86ac-4d04-a6d0-d5cc2f8b4522 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:39.880467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-af689031-86ac-4d04-a6d0-d5cc2f8b4522 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:39.887757 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-af689031-86ac-4d04-a6d0-d5cc2f8b4522 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.146705 May 26 17:00:39.888821 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 156/334] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:39 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:40.767417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a84ac701-950a-4717-9652-f724c0800f2c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:40.768022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a84ac701-950a-4717-9652-f724c0800f2c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:40.774625 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a84ac701-950a-4717-9652-f724c0800f2c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:40.777617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a84ac701-950a-4717-9652-f724c0800f2c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:40.777617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a84ac701-950a-4717-9652-f724c0800f2c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:40.777617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a84ac701-950a-4717-9652-f724c0800f2c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:40.905350 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-24e11583-162c-4025-96a8-7aed9628442d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:40.906719 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-24e11583-162c-4025-96a8-7aed9628442d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:40.915068 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a84ac701-950a-4717-9652-f724c0800f2c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:40.920325 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-24e11583-162c-4025-96a8-7aed9628442d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:40.924722 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a84ac701-950a-4717-9652-f724c0800f2c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.161639 May 26 17:00:40.925535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 179/335] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:40 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:40.925878 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-24e11583-162c-4025-96a8-7aed9628442d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:40.926748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-24e11583-162c-4025-96a8-7aed9628442d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:40.927180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-24e11583-162c-4025-96a8-7aed9628442d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:41.059382 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-24e11583-162c-4025-96a8-7aed9628442d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:41.067651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-24e11583-162c-4025-96a8-7aed9628442d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.166480 May 26 17:00:41.068432 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 157/336] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:40 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:41.941705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-99b9c1a3-8672-418f-9b51-35aaad6679e1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:41.942294 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-99b9c1a3-8672-418f-9b51-35aaad6679e1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:41.948759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-99b9c1a3-8672-418f-9b51-35aaad6679e1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:41.949213 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-99b9c1a3-8672-418f-9b51-35aaad6679e1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:41.950009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-99b9c1a3-8672-418f-9b51-35aaad6679e1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:41.950495 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-99b9c1a3-8672-418f-9b51-35aaad6679e1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:42.085674 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5c0702d5-ea26-4f95-b1ec-9f45919db199 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:42.086220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-99b9c1a3-8672-418f-9b51-35aaad6679e1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:42.087357 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5c0702d5-ea26-4f95-b1ec-9f45919db199 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:42.094234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5c0702d5-ea26-4f95-b1ec-9f45919db199 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:42.094710 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5c0702d5-ea26-4f95-b1ec-9f45919db199 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:42.095117 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-99b9c1a3-8672-418f-9b51-35aaad6679e1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.157263 May 26 17:00:42.095508 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5c0702d5-ea26-4f95-b1ec-9f45919db199 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:42.095914 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5c0702d5-ea26-4f95-b1ec-9f45919db199 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:42.097765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 180/337] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:41 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:42.236149 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5c0702d5-ea26-4f95-b1ec-9f45919db199 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:42.243583 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5c0702d5-ea26-4f95-b1ec-9f45919db199 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.162248 May 26 17:00:42.244154 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 158/338] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:42 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:43.114104 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-56f6f50a-1a1d-4e7a-9303-d2f6a48fb044 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:43.114725 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-56f6f50a-1a1d-4e7a-9303-d2f6a48fb044 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:43.120834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-56f6f50a-1a1d-4e7a-9303-d2f6a48fb044 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:43.121275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-56f6f50a-1a1d-4e7a-9303-d2f6a48fb044 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:43.122022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-56f6f50a-1a1d-4e7a-9303-d2f6a48fb044 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:43.123121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-56f6f50a-1a1d-4e7a-9303-d2f6a48fb044 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:43.261582 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-600c0ed8-819d-4829-93cf-9a07c0398e29 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:43.262359 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-600c0ed8-819d-4829-93cf-9a07c0398e29 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:43.270361 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-600c0ed8-819d-4829-93cf-9a07c0398e29 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:43.270800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-600c0ed8-819d-4829-93cf-9a07c0398e29 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:43.271094 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-56f6f50a-1a1d-4e7a-9303-d2f6a48fb044 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:43.271641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-600c0ed8-819d-4829-93cf-9a07c0398e29 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:43.272245 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-600c0ed8-819d-4829-93cf-9a07c0398e29 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:43.304497 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-56f6f50a-1a1d-4e7a-9303-d2f6a48fb044 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.194152 May 26 17:00:43.305801 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 181/339] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:43 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:43.441325 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-600c0ed8-819d-4829-93cf-9a07c0398e29 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:43.449207 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-600c0ed8-819d-4829-93cf-9a07c0398e29 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.191906 May 26 17:00:43.450052 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 159/340] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:43 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:44.322892 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ee197afc-c55e-4b9f-bdc1-c2fe4b0105c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:44.323514 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ee197afc-c55e-4b9f-bdc1-c2fe4b0105c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:44.330883 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee197afc-c55e-4b9f-bdc1-c2fe4b0105c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:44.331334 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee197afc-c55e-4b9f-bdc1-c2fe4b0105c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:44.332492 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee197afc-c55e-4b9f-bdc1-c2fe4b0105c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:44.333004 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee197afc-c55e-4b9f-bdc1-c2fe4b0105c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:44.467952 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a3928ba5-a1d7-46fc-808c-a20cec5fa97a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:44.468656 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a3928ba5-a1d7-46fc-808c-a20cec5fa97a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:44.475611 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a3928ba5-a1d7-46fc-808c-a20cec5fa97a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:44.476358 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a3928ba5-a1d7-46fc-808c-a20cec5fa97a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:44.477252 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a3928ba5-a1d7-46fc-808c-a20cec5fa97a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:44.477869 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a3928ba5-a1d7-46fc-808c-a20cec5fa97a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:44.494694 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ee197afc-c55e-4b9f-bdc1-c2fe4b0105c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:44.505428 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ee197afc-c55e-4b9f-bdc1-c2fe4b0105c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.186560 May 26 17:00:44.506784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 182/341] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:44 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:44.624458 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a3928ba5-a1d7-46fc-808c-a20cec5fa97a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:44.634295 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a3928ba5-a1d7-46fc-808c-a20cec5fa97a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.171531 May 26 17:00:44.634913 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 160/342] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:44 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:45.522867 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-007db698-c545-4c2e-90a7-7e27c0cdd3a3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:45.523466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-007db698-c545-4c2e-90a7-7e27c0cdd3a3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:45.530836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-007db698-c545-4c2e-90a7-7e27c0cdd3a3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:45.531299 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-007db698-c545-4c2e-90a7-7e27c0cdd3a3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:45.532078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-007db698-c545-4c2e-90a7-7e27c0cdd3a3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:45.532518 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-007db698-c545-4c2e-90a7-7e27c0cdd3a3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:45.651582 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b9c56c94-832d-445a-8969-ad365a26c432 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:45.652241 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b9c56c94-832d-445a-8969-ad365a26c432 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:45.658933 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b9c56c94-832d-445a-8969-ad365a26c432 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:45.659368 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b9c56c94-832d-445a-8969-ad365a26c432 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:45.660129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b9c56c94-832d-445a-8969-ad365a26c432 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:45.660557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b9c56c94-832d-445a-8969-ad365a26c432 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:45.679191 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-007db698-c545-4c2e-90a7-7e27c0cdd3a3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:45.688502 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-007db698-c545-4c2e-90a7-7e27c0cdd3a3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.169351 May 26 17:00:45.689087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 183/343] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:45 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:45.807901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b9c56c94-832d-445a-8969-ad365a26c432 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:45.822856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b9c56c94-832d-445a-8969-ad365a26c432 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.175014 May 26 17:00:45.824487 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 161/344] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:45 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:46.705660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-11c1cb2c-3f87-4645-9acd-17d4d89a1a59 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:46.706276 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-11c1cb2c-3f87-4645-9acd-17d4d89a1a59 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:46.712932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-11c1cb2c-3f87-4645-9acd-17d4d89a1a59 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:46.713255 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-11c1cb2c-3f87-4645-9acd-17d4d89a1a59 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:46.714025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-11c1cb2c-3f87-4645-9acd-17d4d89a1a59 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:46.714487 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-11c1cb2c-3f87-4645-9acd-17d4d89a1a59 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:46.842064 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-144ba760-11f4-455c-baa3-7695c5f560b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:46.844268 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-144ba760-11f4-455c-baa3-7695c5f560b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:46.860230 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-144ba760-11f4-455c-baa3-7695c5f560b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:46.860989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-144ba760-11f4-455c-baa3-7695c5f560b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:46.862261 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-144ba760-11f4-455c-baa3-7695c5f560b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:46.863032 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-144ba760-11f4-455c-baa3-7695c5f560b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:46.866255 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-11c1cb2c-3f87-4645-9acd-17d4d89a1a59 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:46.877674 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-11c1cb2c-3f87-4645-9acd-17d4d89a1a59 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.175790 May 26 17:00:46.878687 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 184/345] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:46 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:47.016447 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-144ba760-11f4-455c-baa3-7695c5f560b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:47.024277 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-144ba760-11f4-455c-baa3-7695c5f560b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.186989 May 26 17:00:47.024840 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 162/346] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:46 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:47.901852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-242478e3-59b4-40eb-a11b-f3ef8996a82b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:47.901852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-242478e3-59b4-40eb-a11b-f3ef8996a82b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:47.901852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-242478e3-59b4-40eb-a11b-f3ef8996a82b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:47.902597 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-242478e3-59b4-40eb-a11b-f3ef8996a82b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:47.903045 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-242478e3-59b4-40eb-a11b-f3ef8996a82b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:47.903481 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-242478e3-59b4-40eb-a11b-f3ef8996a82b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:48.041183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-861c4c02-6ad9-46da-a048-ab29f25da9f6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:48.041789 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-861c4c02-6ad9-46da-a048-ab29f25da9f6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:48.048610 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-861c4c02-6ad9-46da-a048-ab29f25da9f6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:48.048763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-242478e3-59b4-40eb-a11b-f3ef8996a82b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:48.049060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-861c4c02-6ad9-46da-a048-ab29f25da9f6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:48.049851 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-861c4c02-6ad9-46da-a048-ab29f25da9f6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:48.050307 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-861c4c02-6ad9-46da-a048-ab29f25da9f6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:48.057712 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-242478e3-59b4-40eb-a11b-f3ef8996a82b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.166510 May 26 17:00:48.058637 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 185/347] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:47 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:48.183675 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-861c4c02-6ad9-46da-a048-ab29f25da9f6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:48.191263 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-861c4c02-6ad9-46da-a048-ab29f25da9f6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.154090 May 26 17:00:48.191825 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 163/348] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:48 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:49.076023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-027ae723-5e25-428e-a806-8a144e751401 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:49.076643 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-027ae723-5e25-428e-a806-8a144e751401 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:49.083180 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-027ae723-5e25-428e-a806-8a144e751401 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:49.083892 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-027ae723-5e25-428e-a806-8a144e751401 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:49.085226 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-027ae723-5e25-428e-a806-8a144e751401 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:49.085674 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-027ae723-5e25-428e-a806-8a144e751401 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:49.209423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1566caba-be9f-43e9-94c9-a9136e69c83d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:49.210172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1566caba-be9f-43e9-94c9-a9136e69c83d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:49.217212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1566caba-be9f-43e9-94c9-a9136e69c83d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:49.217744 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1566caba-be9f-43e9-94c9-a9136e69c83d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:49.218651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1566caba-be9f-43e9-94c9-a9136e69c83d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:49.219172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1566caba-be9f-43e9-94c9-a9136e69c83d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:49.222055 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-027ae723-5e25-428e-a806-8a144e751401 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:49.229450 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-027ae723-5e25-428e-a806-8a144e751401 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.158583 May 26 17:00:49.230032 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 186/349] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:49 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:49.503897 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1566caba-be9f-43e9-94c9-a9136e69c83d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:49.511345 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1566caba-be9f-43e9-94c9-a9136e69c83d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1326 microversion: 2.1 time: 0.306091 May 26 17:00:49.511911 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 164/350] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:49 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1326 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:50.247149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d449af7b-8fad-4210-956c-bb64ffa652c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:50.247784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d449af7b-8fad-4210-956c-bb64ffa652c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:50.253777 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d449af7b-8fad-4210-956c-bb64ffa652c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:50.254221 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d449af7b-8fad-4210-956c-bb64ffa652c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:50.255010 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d449af7b-8fad-4210-956c-bb64ffa652c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:50.255438 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d449af7b-8fad-4210-956c-bb64ffa652c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:50.385662 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d449af7b-8fad-4210-956c-bb64ffa652c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:50.393704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d449af7b-8fad-4210-956c-bb64ffa652c8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.150429 May 26 17:00:50.394274 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 187/351] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:50 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:50.528941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ab368407-e22b-409f-83e3-89ea611e1ef3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:50.530230 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ab368407-e22b-409f-83e3-89ea611e1ef3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:50.536517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=58 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:50.538042 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab368407-e22b-409f-83e3-89ea611e1ef3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:50.538538 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab368407-e22b-409f-83e3-89ea611e1ef3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:50.539410 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab368407-e22b-409f-83e3-89ea611e1ef3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:50.539864 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab368407-e22b-409f-83e3-89ea611e1ef3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:50.832191 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ab368407-e22b-409f-83e3-89ea611e1ef3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:50.840051 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ab368407-e22b-409f-83e3-89ea611e1ef3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1521 microversion: 2.1 time: 0.315091 May 26 17:00:50.840827 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 165/352] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:50 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:50.857014 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7683d3e9-8982-4ba5-98c0-e0a3791beb6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:50.858087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7683d3e9-8982-4ba5-98c0-e0a3791beb6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:50.864099 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7683d3e9-8982-4ba5-98c0-e0a3791beb6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:50.864614 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7683d3e9-8982-4ba5-98c0-e0a3791beb6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:50.865412 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7683d3e9-8982-4ba5-98c0-e0a3791beb6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:50.865805 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7683d3e9-8982-4ba5-98c0-e0a3791beb6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:50.888911 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-7683d3e9-8982-4ba5-98c0-e0a3791beb6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lazy-loading 'flavor' on Instance uuid dfc8354d-7f45-4c4a-a590-aeadaad33115 {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:00:51.468814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d7bd4ea9-fec1-4cea-95cd-2ef2c9fa2f2b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:51.468814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d7bd4ea9-fec1-4cea-95cd-2ef2c9fa2f2b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:51.468814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d7bd4ea9-fec1-4cea-95cd-2ef2c9fa2f2b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:51.468814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d7bd4ea9-fec1-4cea-95cd-2ef2c9fa2f2b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:51.469295 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d7bd4ea9-fec1-4cea-95cd-2ef2c9fa2f2b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:51.469295 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d7bd4ea9-fec1-4cea-95cd-2ef2c9fa2f2b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:51.559521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d7bd4ea9-fec1-4cea-95cd-2ef2c9fa2f2b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:51.567250 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d7bd4ea9-fec1-4cea-95cd-2ef2c9fa2f2b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.160480 May 26 17:00:51.567825 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 166/353] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:51 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:52.587562 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1b2880d0-f105-4758-8ba9-7baf1a23bfd4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:52.588249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1b2880d0-f105-4758-8ba9-7baf1a23bfd4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:52.595736 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1b2880d0-f105-4758-8ba9-7baf1a23bfd4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:52.596183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1b2880d0-f105-4758-8ba9-7baf1a23bfd4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:52.596943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1b2880d0-f105-4758-8ba9-7baf1a23bfd4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:52.597375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1b2880d0-f105-4758-8ba9-7baf1a23bfd4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:52.869534 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7683d3e9-8982-4ba5-98c0-e0a3791beb6a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "POST /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115/action" status: 200 len: 32 microversion: 2.1 time: 2.016864 May 26 17:00:52.874723 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 188/354] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:00:50 2022] POST /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115/action => generated 32 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:00:52.880220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-37c1dc05-e4b4-498b-8a44-fc7065589e8a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:52.880957 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-37c1dc05-e4b4-498b-8a44-fc7065589e8a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:52.886576 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=52 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:52.889087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-37c1dc05-e4b4-498b-8a44-fc7065589e8a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:52.889542 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-37c1dc05-e4b4-498b-8a44-fc7065589e8a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:52.890341 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-37c1dc05-e4b4-498b-8a44-fc7065589e8a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:52.890966 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-37c1dc05-e4b4-498b-8a44-fc7065589e8a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:52.971348 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1b2880d0-f105-4758-8ba9-7baf1a23bfd4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:52.978812 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1b2880d0-f105-4758-8ba9-7baf1a23bfd4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.395231 May 26 17:00:52.979477 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 167/355] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:52 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:53.042706 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-37c1dc05-e4b4-498b-8a44-fc7065589e8a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:53.050864 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-37c1dc05-e4b4-498b-8a44-fc7065589e8a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.174893 May 26 17:00:53.051424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 189/356] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:52 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:53.995641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e88efe81-5d01-4124-b824-9ce80ed94eb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:53.996252 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e88efe81-5d01-4124-b824-9ce80ed94eb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:54.003120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e88efe81-5d01-4124-b824-9ce80ed94eb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:54.003566 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e88efe81-5d01-4124-b824-9ce80ed94eb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:54.004324 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e88efe81-5d01-4124-b824-9ce80ed94eb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:54.004759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e88efe81-5d01-4124-b824-9ce80ed94eb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:54.067786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-29ec2a29-9006-4b97-8296-ad50383c81ac tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:54.068401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-29ec2a29-9006-4b97-8296-ad50383c81ac tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:54.074665 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-29ec2a29-9006-4b97-8296-ad50383c81ac tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:54.075718 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-29ec2a29-9006-4b97-8296-ad50383c81ac tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:54.076444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-29ec2a29-9006-4b97-8296-ad50383c81ac tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:54.076882 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-29ec2a29-9006-4b97-8296-ad50383c81ac tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:54.135267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e88efe81-5d01-4124-b824-9ce80ed94eb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:54.144498 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e88efe81-5d01-4124-b824-9ce80ed94eb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.152752 May 26 17:00:54.145064 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 168/357] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:53 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:54.205582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-29ec2a29-9006-4b97-8296-ad50383c81ac tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:54.213297 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-29ec2a29-9006-4b97-8296-ad50383c81ac tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.149358 May 26 17:00:54.213863 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 190/358] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:54 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:55.161319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8df935eb-2d3b-42f1-a915-60d7867f79c7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:55.161938 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8df935eb-2d3b-42f1-a915-60d7867f79c7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:55.168394 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8df935eb-2d3b-42f1-a915-60d7867f79c7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:55.168943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8df935eb-2d3b-42f1-a915-60d7867f79c7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:55.170200 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8df935eb-2d3b-42f1-a915-60d7867f79c7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:55.170727 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8df935eb-2d3b-42f1-a915-60d7867f79c7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:55.230892 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-48b00d49-6604-4bed-adfb-22dbb34432d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:55.232052 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-48b00d49-6604-4bed-adfb-22dbb34432d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:55.238290 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48b00d49-6604-4bed-adfb-22dbb34432d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:55.238770 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48b00d49-6604-4bed-adfb-22dbb34432d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:55.239531 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48b00d49-6604-4bed-adfb-22dbb34432d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:55.239965 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48b00d49-6604-4bed-adfb-22dbb34432d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:55.310981 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8df935eb-2d3b-42f1-a915-60d7867f79c7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:55.318455 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8df935eb-2d3b-42f1-a915-60d7867f79c7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.160872 May 26 17:00:55.319032 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 169/359] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:55 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:55.372421 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-48b00d49-6604-4bed-adfb-22dbb34432d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:55.379802 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-48b00d49-6604-4bed-adfb-22dbb34432d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.152797 May 26 17:00:55.380393 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 191/360] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:55 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:56.335423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5c3c067d-7241-401f-b025-4558ec865582 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:56.336074 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5c3c067d-7241-401f-b025-4558ec865582 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:56.342755 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5c3c067d-7241-401f-b025-4558ec865582 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:56.343205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5c3c067d-7241-401f-b025-4558ec865582 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:56.343958 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5c3c067d-7241-401f-b025-4558ec865582 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:56.344391 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5c3c067d-7241-401f-b025-4558ec865582 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:56.346881 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:56.396859 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-54fe9984-cf36-4fe0-b1f4-157cb385cec5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:56.397573 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-54fe9984-cf36-4fe0-b1f4-157cb385cec5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:56.403649 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54fe9984-cf36-4fe0-b1f4-157cb385cec5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:56.404102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54fe9984-cf36-4fe0-b1f4-157cb385cec5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:56.404863 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54fe9984-cf36-4fe0-b1f4-157cb385cec5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:56.405296 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54fe9984-cf36-4fe0-b1f4-157cb385cec5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:56.476135 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5c3c067d-7241-401f-b025-4558ec865582 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:56.484678 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5c3c067d-7241-401f-b025-4558ec865582 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.153287 May 26 17:00:56.485623 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 170/361] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:56 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:56.537442 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-54fe9984-cf36-4fe0-b1f4-157cb385cec5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:56.545777 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-54fe9984-cf36-4fe0-b1f4-157cb385cec5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.152728 May 26 17:00:56.546370 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 192/362] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:56 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:57.502055 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ed63ce25-36ee-4d41-bce8-5eeddeedbaa6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:57.502649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ed63ce25-36ee-4d41-bce8-5eeddeedbaa6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:57.509157 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed63ce25-36ee-4d41-bce8-5eeddeedbaa6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:57.509660 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed63ce25-36ee-4d41-bce8-5eeddeedbaa6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:57.510447 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed63ce25-36ee-4d41-bce8-5eeddeedbaa6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:57.510881 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed63ce25-36ee-4d41-bce8-5eeddeedbaa6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:57.564776 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9c4f17ca-8e89-414b-9d57-7d55346fb4c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:57.565837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9c4f17ca-8e89-414b-9d57-7d55346fb4c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:57.581307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9c4f17ca-8e89-414b-9d57-7d55346fb4c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:57.581751 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9c4f17ca-8e89-414b-9d57-7d55346fb4c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:57.583011 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9c4f17ca-8e89-414b-9d57-7d55346fb4c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:57.583444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9c4f17ca-8e89-414b-9d57-7d55346fb4c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:57.602021 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:57.643471 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ed63ce25-36ee-4d41-bce8-5eeddeedbaa6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:57.650797 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ed63ce25-36ee-4d41-bce8-5eeddeedbaa6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.153633 May 26 17:00:57.651354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 171/363] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:57 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:57.715461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9c4f17ca-8e89-414b-9d57-7d55346fb4c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:57.722798 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9c4f17ca-8e89-414b-9d57-7d55346fb4c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.163612 May 26 17:00:57.723356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 193/364] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:57 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:58.667591 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4f935ca7-7b23-4502-a65e-dbc6960a5c5e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:58.668192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4f935ca7-7b23-4502-a65e-dbc6960a5c5e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:58.674721 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4f935ca7-7b23-4502-a65e-dbc6960a5c5e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:58.675240 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4f935ca7-7b23-4502-a65e-dbc6960a5c5e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:58.675895 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4f935ca7-7b23-4502-a65e-dbc6960a5c5e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:58.676327 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4f935ca7-7b23-4502-a65e-dbc6960a5c5e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:58.740000 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f9d6f2d4-faaa-4b50-ac2d-5ab908325504 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:58.740582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f9d6f2d4-faaa-4b50-ac2d-5ab908325504 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:58.746595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f9d6f2d4-faaa-4b50-ac2d-5ab908325504 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:58.747564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f9d6f2d4-faaa-4b50-ac2d-5ab908325504 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:58.748324 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f9d6f2d4-faaa-4b50-ac2d-5ab908325504 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:58.748754 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f9d6f2d4-faaa-4b50-ac2d-5ab908325504 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:58.829727 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4f935ca7-7b23-4502-a65e-dbc6960a5c5e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:58.839522 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4f935ca7-7b23-4502-a65e-dbc6960a5c5e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.175779 May 26 17:00:58.840093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 172/365] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:58 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:58.888312 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f9d6f2d4-faaa-4b50-ac2d-5ab908325504 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:58.896175 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f9d6f2d4-faaa-4b50-ac2d-5ab908325504 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.160076 May 26 17:00:58.896741 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 194/366] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:58 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:59.857029 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-65a63b3e-a964-4b0d-b5bd-8fc06a178ce2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:59.858012 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-65a63b3e-a964-4b0d-b5bd-8fc06a178ce2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:59.864812 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-65a63b3e-a964-4b0d-b5bd-8fc06a178ce2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.865266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-65a63b3e-a964-4b0d-b5bd-8fc06a178ce2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.866030 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-65a63b3e-a964-4b0d-b5bd-8fc06a178ce2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.866625 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-65a63b3e-a964-4b0d-b5bd-8fc06a178ce2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.913014 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2bb0c2fd-479d-46d9-a88c-14148348f2f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:59.913650 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2bb0c2fd-479d-46d9-a88c-14148348f2f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:59.920491 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2bb0c2fd-479d-46d9-a88c-14148348f2f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.920954 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2bb0c2fd-479d-46d9-a88c-14148348f2f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.921907 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2bb0c2fd-479d-46d9-a88c-14148348f2f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.922717 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2bb0c2fd-479d-46d9-a88c-14148348f2f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.999153 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-65a63b3e-a964-4b0d-b5bd-8fc06a178ce2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:00.006748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-65a63b3e-a964-4b0d-b5bd-8fc06a178ce2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.154215 May 26 17:01:00.007606 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 173/367] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:59 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:00.061498 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2bb0c2fd-479d-46d9-a88c-14148348f2f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:00.069330 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2bb0c2fd-479d-46d9-a88c-14148348f2f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.160166 May 26 17:01:00.070088 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 195/368] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:00:59 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:01.024065 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cfe8b153-61d7-4dcd-b779-c505a837cfcb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:01.024750 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cfe8b153-61d7-4dcd-b779-c505a837cfcb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:01.031200 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfe8b153-61d7-4dcd-b779-c505a837cfcb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:01.031699 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfe8b153-61d7-4dcd-b779-c505a837cfcb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:01.032459 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfe8b153-61d7-4dcd-b779-c505a837cfcb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:01.032884 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfe8b153-61d7-4dcd-b779-c505a837cfcb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:01.086345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f219b80f-165b-47a1-8e3b-d1af34bbb4af tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:01.086959 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f219b80f-165b-47a1-8e3b-d1af34bbb4af tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:01.093218 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f219b80f-165b-47a1-8e3b-d1af34bbb4af tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:01.093677 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f219b80f-165b-47a1-8e3b-d1af34bbb4af tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:01.094477 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f219b80f-165b-47a1-8e3b-d1af34bbb4af tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:01.094914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f219b80f-165b-47a1-8e3b-d1af34bbb4af tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:01.171521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cfe8b153-61d7-4dcd-b779-c505a837cfcb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:01.179063 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cfe8b153-61d7-4dcd-b779-c505a837cfcb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.158738 May 26 17:01:01.179659 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 174/369] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:01 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:01.244376 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f219b80f-165b-47a1-8e3b-d1af34bbb4af tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:01.252755 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f219b80f-165b-47a1-8e3b-d1af34bbb4af tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.170498 May 26 17:01:01.253328 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 196/370] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:01 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:02.197054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c8bc2a76-7c46-48d7-8f83-56d3a398b054 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:02.197665 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c8bc2a76-7c46-48d7-8f83-56d3a398b054 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:02.205235 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c8bc2a76-7c46-48d7-8f83-56d3a398b054 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:02.205689 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c8bc2a76-7c46-48d7-8f83-56d3a398b054 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:02.206505 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c8bc2a76-7c46-48d7-8f83-56d3a398b054 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:02.206944 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c8bc2a76-7c46-48d7-8f83-56d3a398b054 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:02.270427 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-420f7476-3e3e-4d77-951b-d35013375083 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:02.271041 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-420f7476-3e3e-4d77-951b-d35013375083 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:02.277681 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-420f7476-3e3e-4d77-951b-d35013375083 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:02.278202 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-420f7476-3e3e-4d77-951b-d35013375083 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:02.279908 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-420f7476-3e3e-4d77-951b-d35013375083 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:02.280383 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-420f7476-3e3e-4d77-951b-d35013375083 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:02.344076 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c8bc2a76-7c46-48d7-8f83-56d3a398b054 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:02.360205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c8bc2a76-7c46-48d7-8f83-56d3a398b054 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.166946 May 26 17:01:02.367648 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 175/371] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:02 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:02.427622 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-420f7476-3e3e-4d77-951b-d35013375083 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:02.438769 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-420f7476-3e3e-4d77-951b-d35013375083 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.172248 May 26 17:01:02.439726 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 197/372] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:02 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:03.377538 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0992c32a-f90f-48a6-be2a-2f705ec1d1ed tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:03.378253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0992c32a-f90f-48a6-be2a-2f705ec1d1ed tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:03.385051 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0992c32a-f90f-48a6-be2a-2f705ec1d1ed tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:03.385566 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0992c32a-f90f-48a6-be2a-2f705ec1d1ed tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:03.386428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0992c32a-f90f-48a6-be2a-2f705ec1d1ed tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:03.386926 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0992c32a-f90f-48a6-be2a-2f705ec1d1ed tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:03.463415 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e2c9d6c0-54dc-4323-9480-95c31a563823 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:03.463415 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e2c9d6c0-54dc-4323-9480-95c31a563823 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:03.469056 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e2c9d6c0-54dc-4323-9480-95c31a563823 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:03.469624 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e2c9d6c0-54dc-4323-9480-95c31a563823 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:03.470272 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e2c9d6c0-54dc-4323-9480-95c31a563823 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:03.472216 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e2c9d6c0-54dc-4323-9480-95c31a563823 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:03.578168 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0992c32a-f90f-48a6-be2a-2f705ec1d1ed tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:03.592644 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0992c32a-f90f-48a6-be2a-2f705ec1d1ed tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.217812 May 26 17:01:03.593841 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 176/373] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:03 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:03.673281 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e2c9d6c0-54dc-4323-9480-95c31a563823 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:03.682896 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e2c9d6c0-54dc-4323-9480-95c31a563823 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.229318 May 26 17:01:03.683482 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 198/374] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:03 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:04.609643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-83a7a5f7-781e-418f-b2bd-a906b27827a4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:04.610288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-83a7a5f7-781e-418f-b2bd-a906b27827a4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:04.616852 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-83a7a5f7-781e-418f-b2bd-a906b27827a4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:04.617294 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-83a7a5f7-781e-418f-b2bd-a906b27827a4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:04.618205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-83a7a5f7-781e-418f-b2bd-a906b27827a4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:04.618671 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-83a7a5f7-781e-418f-b2bd-a906b27827a4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:04.701694 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a009afbc-c10c-46c4-9407-0bd1005ae99b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:04.702430 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a009afbc-c10c-46c4-9407-0bd1005ae99b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:04.708755 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a009afbc-c10c-46c4-9407-0bd1005ae99b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:04.709129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a009afbc-c10c-46c4-9407-0bd1005ae99b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:04.709886 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a009afbc-c10c-46c4-9407-0bd1005ae99b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:04.710314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a009afbc-c10c-46c4-9407-0bd1005ae99b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:04.755442 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-83a7a5f7-781e-418f-b2bd-a906b27827a4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:04.763146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-83a7a5f7-781e-418f-b2bd-a906b27827a4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.157459 May 26 17:01:04.764258 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 177/375] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:04 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:04.842043 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a009afbc-c10c-46c4-9407-0bd1005ae99b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:04.849765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a009afbc-c10c-46c4-9407-0bd1005ae99b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.153019 May 26 17:01:04.850346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 199/376] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:04 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:05.781178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c7e7478b-8a17-49d2-92d1-80d36b2febd7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:05.781789 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c7e7478b-8a17-49d2-92d1-80d36b2febd7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:05.788368 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c7e7478b-8a17-49d2-92d1-80d36b2febd7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:05.788815 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c7e7478b-8a17-49d2-92d1-80d36b2febd7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:05.789575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c7e7478b-8a17-49d2-92d1-80d36b2febd7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:05.790007 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c7e7478b-8a17-49d2-92d1-80d36b2febd7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:05.866819 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0fa4a1cc-566b-4089-abc9-1a4d800cace0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:05.867507 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0fa4a1cc-566b-4089-abc9-1a4d800cace0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:05.874005 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0fa4a1cc-566b-4089-abc9-1a4d800cace0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:05.874486 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0fa4a1cc-566b-4089-abc9-1a4d800cace0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:05.875460 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0fa4a1cc-566b-4089-abc9-1a4d800cace0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:05.875900 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0fa4a1cc-566b-4089-abc9-1a4d800cace0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:05.941978 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c7e7478b-8a17-49d2-92d1-80d36b2febd7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:05.949185 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c7e7478b-8a17-49d2-92d1-80d36b2febd7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.172700 May 26 17:01:05.949754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 178/377] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:05 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:06.011450 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0fa4a1cc-566b-4089-abc9-1a4d800cace0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:06.019897 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0fa4a1cc-566b-4089-abc9-1a4d800cace0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.156876 May 26 17:01:06.020479 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 200/378] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:05 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:06.967121 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0b3ebeec-1f1e-409b-b33a-5057c4655ac7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:06.968082 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0b3ebeec-1f1e-409b-b33a-5057c4655ac7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:06.975039 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0b3ebeec-1f1e-409b-b33a-5057c4655ac7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:06.975486 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0b3ebeec-1f1e-409b-b33a-5057c4655ac7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:06.976252 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0b3ebeec-1f1e-409b-b33a-5057c4655ac7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:06.976684 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0b3ebeec-1f1e-409b-b33a-5057c4655ac7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:07.037118 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d92ac730-1f01-47ea-a202-8bfb5dbaf732 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:07.037771 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d92ac730-1f01-47ea-a202-8bfb5dbaf732 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:07.043783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d92ac730-1f01-47ea-a202-8bfb5dbaf732 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:07.044275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d92ac730-1f01-47ea-a202-8bfb5dbaf732 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:07.045053 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d92ac730-1f01-47ea-a202-8bfb5dbaf732 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:07.045481 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d92ac730-1f01-47ea-a202-8bfb5dbaf732 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:07.128596 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0b3ebeec-1f1e-409b-b33a-5057c4655ac7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:07.140882 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0b3ebeec-1f1e-409b-b33a-5057c4655ac7 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.175674 May 26 17:01:07.145145 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 179/379] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:06 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:07.196837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d92ac730-1f01-47ea-a202-8bfb5dbaf732 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:07.204604 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-e4f16341-687a-4397-b09c-579b6fa7cd94 req-8bca8a40-b495-4313-99cd-c04b1c3c34eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d526ee14-28c1-46f0-97e9-37aecfc19059", "name": "network-vif-plugged", "status": "completed", "tag": "8f683af9-2af5-45b8-b6cb-ef44b939789d"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:07.206013 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d92ac730-1f01-47ea-a202-8bfb5dbaf732 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.172887 May 26 17:01:07.206646 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 201/380] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:07 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:07.214817 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-e4f16341-687a-4397-b09c-579b6fa7cd94 req-8bca8a40-b495-4313-99cd-c04b1c3c34eb service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:07.215364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-e4f16341-687a-4397-b09c-579b6fa7cd94 req-8bca8a40-b495-4313-99cd-c04b1c3c34eb service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:07.226884 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-e4f16341-687a-4397-b09c-579b6fa7cd94 req-8bca8a40-b495-4313-99cd-c04b1c3c34eb service nova] Creating event network-vif-plugged:8f683af9-2af5-45b8-b6cb-ef44b939789d for instance d526ee14-28c1-46f0-97e9-37aecfc19059 on hv-cinder-83607 May 26 17:01:07.232553 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-e4f16341-687a-4397-b09c-579b6fa7cd94 req-8bca8a40-b495-4313-99cd-c04b1c3c34eb service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040770 May 26 17:01:07.233390 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 180/381] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:01:08.161306 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-451b262e-993b-4710-ab04-b2546f2e128c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:08.161917 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-451b262e-993b-4710-ab04-b2546f2e128c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:08.167986 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-451b262e-993b-4710-ab04-b2546f2e128c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:08.168430 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-451b262e-993b-4710-ab04-b2546f2e128c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:08.169338 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-451b262e-993b-4710-ab04-b2546f2e128c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:08.170066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-451b262e-993b-4710-ab04-b2546f2e128c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:08.227980 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8a643d43-4cda-454e-abd8-66d784834f65 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:08.229153 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8a643d43-4cda-454e-abd8-66d784834f65 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:08.239934 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8a643d43-4cda-454e-abd8-66d784834f65 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:08.240431 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8a643d43-4cda-454e-abd8-66d784834f65 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:08.241217 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8a643d43-4cda-454e-abd8-66d784834f65 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:08.241655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8a643d43-4cda-454e-abd8-66d784834f65 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:08.322226 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-451b262e-993b-4710-ab04-b2546f2e128c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:08.330214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-451b262e-993b-4710-ab04-b2546f2e128c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.172737 May 26 17:01:08.331015 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 202/382] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:08 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:08.389431 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8a643d43-4cda-454e-abd8-66d784834f65 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:08.397093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8a643d43-4cda-454e-abd8-66d784834f65 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.174384 May 26 17:01:08.397660 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 181/383] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:08 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:09.347746 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4323bce8-820a-46db-8445-a374648cf89d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:09.348349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4323bce8-820a-46db-8445-a374648cf89d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:09.354492 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4323bce8-820a-46db-8445-a374648cf89d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:09.354930 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4323bce8-820a-46db-8445-a374648cf89d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:09.355671 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4323bce8-820a-46db-8445-a374648cf89d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:09.356098 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4323bce8-820a-46db-8445-a374648cf89d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:09.414721 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-df2350cc-71a2-4a46-8063-6e81e3297bc3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:09.415331 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-df2350cc-71a2-4a46-8063-6e81e3297bc3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:09.422083 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-df2350cc-71a2-4a46-8063-6e81e3297bc3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:09.422572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-df2350cc-71a2-4a46-8063-6e81e3297bc3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:09.423340 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-df2350cc-71a2-4a46-8063-6e81e3297bc3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:09.423777 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-df2350cc-71a2-4a46-8063-6e81e3297bc3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:09.485399 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4323bce8-820a-46db-8445-a374648cf89d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:09.492776 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4323bce8-820a-46db-8445-a374648cf89d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.148806 May 26 17:01:09.493346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 203/384] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:09 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:09.552162 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-df2350cc-71a2-4a46-8063-6e81e3297bc3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:09.559714 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-df2350cc-71a2-4a46-8063-6e81e3297bc3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.149192 May 26 17:01:09.560360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 182/385] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:09 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:10.509417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e3871e0f-ec8c-45c7-90dc-d3973e228062 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:10.510023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e3871e0f-ec8c-45c7-90dc-d3973e228062 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:10.516842 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e3871e0f-ec8c-45c7-90dc-d3973e228062 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:10.517316 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e3871e0f-ec8c-45c7-90dc-d3973e228062 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:10.518090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e3871e0f-ec8c-45c7-90dc-d3973e228062 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:10.518534 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e3871e0f-ec8c-45c7-90dc-d3973e228062 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:10.577101 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-692faacd-16c2-4c90-86e7-85a58ad0bda0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:10.577700 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-692faacd-16c2-4c90-86e7-85a58ad0bda0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:10.584293 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-692faacd-16c2-4c90-86e7-85a58ad0bda0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:10.584734 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-692faacd-16c2-4c90-86e7-85a58ad0bda0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:10.585488 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-692faacd-16c2-4c90-86e7-85a58ad0bda0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:10.585908 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-692faacd-16c2-4c90-86e7-85a58ad0bda0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:10.650496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e3871e0f-ec8c-45c7-90dc-d3973e228062 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:10.657806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e3871e0f-ec8c-45c7-90dc-d3973e228062 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.152148 May 26 17:01:10.658398 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 204/386] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:10 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:10.717994 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-692faacd-16c2-4c90-86e7-85a58ad0bda0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:10.725427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-692faacd-16c2-4c90-86e7-85a58ad0bda0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.152804 May 26 17:01:10.725992 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 183/387] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:10 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:11.674807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9f409e71-37ec-45be-9c28-800666b6e02a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:11.675337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9f409e71-37ec-45be-9c28-800666b6e02a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:11.681300 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9f409e71-37ec-45be-9c28-800666b6e02a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:11.681743 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9f409e71-37ec-45be-9c28-800666b6e02a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:11.682525 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9f409e71-37ec-45be-9c28-800666b6e02a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:11.682958 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9f409e71-37ec-45be-9c28-800666b6e02a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:11.743266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1bacb4dc-a7d1-4d6f-b11e-7c7fbb7f3322 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:11.744099 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1bacb4dc-a7d1-4d6f-b11e-7c7fbb7f3322 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:11.751448 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1bacb4dc-a7d1-4d6f-b11e-7c7fbb7f3322 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:11.751898 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1bacb4dc-a7d1-4d6f-b11e-7c7fbb7f3322 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:11.752711 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1bacb4dc-a7d1-4d6f-b11e-7c7fbb7f3322 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:11.753168 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1bacb4dc-a7d1-4d6f-b11e-7c7fbb7f3322 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:11.811890 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9f409e71-37ec-45be-9c28-800666b6e02a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:11.822770 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9f409e71-37ec-45be-9c28-800666b6e02a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.150162 May 26 17:01:11.823461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 205/388] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:11 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:11.890712 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1bacb4dc-a7d1-4d6f-b11e-7c7fbb7f3322 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:11.898031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1bacb4dc-a7d1-4d6f-b11e-7c7fbb7f3322 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.159037 May 26 17:01:11.898634 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 184/389] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:11 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:12.840546 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ca16042c-a510-4b1c-837e-a83c0b3000b4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:12.842171 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ca16042c-a510-4b1c-837e-a83c0b3000b4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:12.847879 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ca16042c-a510-4b1c-837e-a83c0b3000b4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:12.853599 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ca16042c-a510-4b1c-837e-a83c0b3000b4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:12.853599 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ca16042c-a510-4b1c-837e-a83c0b3000b4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:12.853599 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ca16042c-a510-4b1c-837e-a83c0b3000b4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:12.914843 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-bc594e10-38dd-4248-8803-a59a0ba4301c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:12.915463 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-bc594e10-38dd-4248-8803-a59a0ba4301c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:12.922212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bc594e10-38dd-4248-8803-a59a0ba4301c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:12.922700 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bc594e10-38dd-4248-8803-a59a0ba4301c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:12.923478 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bc594e10-38dd-4248-8803-a59a0ba4301c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:12.923916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bc594e10-38dd-4248-8803-a59a0ba4301c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:12.991428 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ca16042c-a510-4b1c-837e-a83c0b3000b4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:12.999419 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ca16042c-a510-4b1c-837e-a83c0b3000b4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.162791 May 26 17:01:13.000218 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 206/390] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:12 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:13.064908 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bc594e10-38dd-4248-8803-a59a0ba4301c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:13.072332 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-bc594e10-38dd-4248-8803-a59a0ba4301c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.161294 May 26 17:01:13.072904 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 185/391] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:12 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:14.016442 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-baf5a8da-33d1-453f-8b58-9e348b800af5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:14.017056 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-baf5a8da-33d1-453f-8b58-9e348b800af5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:14.023155 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-baf5a8da-33d1-453f-8b58-9e348b800af5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:14.023598 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-baf5a8da-33d1-453f-8b58-9e348b800af5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:14.024356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-baf5a8da-33d1-453f-8b58-9e348b800af5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:14.024791 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-baf5a8da-33d1-453f-8b58-9e348b800af5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:14.090307 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b23b9e71-2d07-424b-82b5-93c107e07b0f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:14.091593 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b23b9e71-2d07-424b-82b5-93c107e07b0f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:14.098046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b23b9e71-2d07-424b-82b5-93c107e07b0f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:14.098617 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b23b9e71-2d07-424b-82b5-93c107e07b0f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:14.099441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b23b9e71-2d07-424b-82b5-93c107e07b0f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:14.099968 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b23b9e71-2d07-424b-82b5-93c107e07b0f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:14.158081 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-baf5a8da-33d1-453f-8b58-9e348b800af5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:14.165951 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-baf5a8da-33d1-453f-8b58-9e348b800af5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.153418 May 26 17:01:14.166478 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 207/392] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:14 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:14.234812 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b23b9e71-2d07-424b-82b5-93c107e07b0f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:14.242190 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b23b9e71-2d07-424b-82b5-93c107e07b0f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.155910 May 26 17:01:14.242778 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 186/393] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:14 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:15.182672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ec4634da-07d7-456c-965e-a36cf6561c0c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:15.183265 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ec4634da-07d7-456c-965e-a36cf6561c0c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:15.189819 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec4634da-07d7-456c-965e-a36cf6561c0c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:15.190255 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec4634da-07d7-456c-965e-a36cf6561c0c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:15.191031 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec4634da-07d7-456c-965e-a36cf6561c0c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:15.191454 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec4634da-07d7-456c-965e-a36cf6561c0c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:15.260617 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-39180925-a8b2-4b72-858b-0e9da5bd1df0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:15.261756 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-39180925-a8b2-4b72-858b-0e9da5bd1df0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:15.268704 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-39180925-a8b2-4b72-858b-0e9da5bd1df0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:15.269366 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-39180925-a8b2-4b72-858b-0e9da5bd1df0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:15.270128 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-39180925-a8b2-4b72-858b-0e9da5bd1df0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:15.270579 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-39180925-a8b2-4b72-858b-0e9da5bd1df0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:15.286078 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:15.329121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ec4634da-07d7-456c-965e-a36cf6561c0c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:15.336940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ec4634da-07d7-456c-965e-a36cf6561c0c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.158176 May 26 17:01:15.337519 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 208/394] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:15 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:15.404290 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-39180925-a8b2-4b72-858b-0e9da5bd1df0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:15.411752 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-39180925-a8b2-4b72-858b-0e9da5bd1df0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.155937 May 26 17:01:15.412317 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 187/395] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:15 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:16.355751 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3db8edcc-0fcb-4950-8caa-172d4260915b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:16.356917 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3db8edcc-0fcb-4950-8caa-172d4260915b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:16.362870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3db8edcc-0fcb-4950-8caa-172d4260915b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:16.363315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3db8edcc-0fcb-4950-8caa-172d4260915b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:16.364101 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3db8edcc-0fcb-4950-8caa-172d4260915b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:16.364536 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3db8edcc-0fcb-4950-8caa-172d4260915b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:16.429304 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0cbc4e71-ed4d-4762-bcd3-0d8875f68e55 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:16.429948 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0cbc4e71-ed4d-4762-bcd3-0d8875f68e55 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:16.437248 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0cbc4e71-ed4d-4762-bcd3-0d8875f68e55 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:16.437700 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0cbc4e71-ed4d-4762-bcd3-0d8875f68e55 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:16.438499 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0cbc4e71-ed4d-4762-bcd3-0d8875f68e55 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:16.438934 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0cbc4e71-ed4d-4762-bcd3-0d8875f68e55 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:16.582101 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0cbc4e71-ed4d-4762-bcd3-0d8875f68e55 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:16.590526 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0cbc4e71-ed4d-4762-bcd3-0d8875f68e55 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.165048 May 26 17:01:16.600314 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 188/396] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:16 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:16.692104 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3db8edcc-0fcb-4950-8caa-172d4260915b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:16.699762 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3db8edcc-0fcb-4950-8caa-172d4260915b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1361 microversion: 2.1 time: 0.347806 May 26 17:01:16.700652 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 209/397] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:16 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:17.273396 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2016293407", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2141156347", "security_groups": [{"name": "tempest-secgroup-smoke-1976980798"}], "block_device_mapping_v2": [{"uuid": "a9371076-e47e-4a2f-9969-a6acd0e1025d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "73acc420-8851-42b7-81fc-cd9808652b9c"}]}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:17.400901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] validate_networks() for [('73acc420-8851-42b7-81fc-cd9808652b9c', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:01:17.608057 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2da011c8-fe6c-4b8e-9ab6-5198e9a610d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:17.608659 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2da011c8-fe6c-4b8e-9ab6-5198e9a610d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:17.614538 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2da011c8-fe6c-4b8e-9ab6-5198e9a610d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:17.615705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2da011c8-fe6c-4b8e-9ab6-5198e9a610d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:17.615705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2da011c8-fe6c-4b8e-9ab6-5198e9a610d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:17.616298 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2da011c8-fe6c-4b8e-9ab6-5198e9a610d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:17.620221 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:17.782427 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2da011c8-fe6c-4b8e-9ab6-5198e9a610d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:17.786934 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2da011c8-fe6c-4b8e-9ab6-5198e9a610d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.182773 May 26 17:01:17.787575 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 210/398] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:17 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:17.793241 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-421efce2-fafb-482e-95e8-e169004e25aa tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:17.794546 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-421efce2-fafb-482e-95e8-e169004e25aa tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:17.801311 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-421efce2-fafb-482e-95e8-e169004e25aa tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:17.802120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-421efce2-fafb-482e-95e8-e169004e25aa tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:17.805000 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-421efce2-fafb-482e-95e8-e169004e25aa tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:17.805000 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-421efce2-fafb-482e-95e8-e169004e25aa tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:17.843852 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:01:17.844604 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:01:17.845198 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:01:17.845682 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:01:17.846159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:01:17.855326 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:17.856100 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:17.857740 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:17.858188 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:17.877430 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Getting quotas for project ed4f536fcafe46b5ae159b93acb7e041. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:01:17.884703 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Getting quotas for user 530b2b1951644755afd1432381cf37f9 and project ed4f536fcafe46b5ae159b93acb7e041. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:01:17.948220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-421efce2-fafb-482e-95e8-e169004e25aa tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:17.959450 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-421efce2-fafb-482e-95e8-e169004e25aa tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1551 microversion: 2.1 time: 0.168308 May 26 17:01:17.959450 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 211/399] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:17 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:17.959642 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:01:17.961487 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a9371076-e47e-4a2f-9969-a6acd0e1025d',volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:01:17.974810 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ae40a70a-1eed-428a-b311-2f025569dc9b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:17.975420 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ae40a70a-1eed-428a-b311-2f025569dc9b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:17.985112 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ae40a70a-1eed-428a-b311-2f025569dc9b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:17.985566 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ae40a70a-1eed-428a-b311-2f025569dc9b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:17.986389 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ae40a70a-1eed-428a-b311-2f025569dc9b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:17.986850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ae40a70a-1eed-428a-b311-2f025569dc9b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:18.114552 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ae40a70a-1eed-428a-b311-2f025569dc9b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:18.120886 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ae40a70a-1eed-428a-b311-2f025569dc9b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1551 microversion: 2.1 time: 0.150037 May 26 17:01:18.121454 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 212/400] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:17 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:18.136596 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9ef2b178-91d0-46f8-b661-9ddc3ec01d1e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:18.140023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9ef2b178-91d0-46f8-b661-9ddc3ec01d1e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:18.140767 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9ef2b178-91d0-46f8-b661-9ddc3ec01d1e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Searching by: {'deleted': False, 'project_id': '3684109c25814f2dadd52c7f00d5e025'} {{(pid=130526) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 17:01:18.147239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9ef2b178-91d0-46f8-b661-9ddc3ec01d1e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:18.148444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9ef2b178-91d0-46f8-b661-9ddc3ec01d1e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:18.148444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9ef2b178-91d0-46f8-b661-9ddc3ec01d1e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:18.148838 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9ef2b178-91d0-46f8-b661-9ddc3ec01d1e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:18.238948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.multi_cell_list [None req-9ef2b178-91d0-46f8-b661-9ddc3ec01d1e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130526) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 17:01:18.334710 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9ef2b178-91d0-46f8-b661-9ddc3ec01d1e tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.201596 May 26 17:01:18.335295 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 213/401] 10.222.0.112 () {58 vars in 1129 bytes} [Thu May 26 17:01:18 2022] GET /compute/v2.1/servers => generated 344 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:01:18.346187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e11338b8-12fd-4bd0-86f0-7e35610d188d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:18.346858 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e11338b8-12fd-4bd0-86f0-7e35610d188d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:18.352692 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e11338b8-12fd-4bd0-86f0-7e35610d188d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:18.353145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e11338b8-12fd-4bd0-86f0-7e35610d188d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:18.353899 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e11338b8-12fd-4bd0-86f0-7e35610d188d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:18.354377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e11338b8-12fd-4bd0-86f0-7e35610d188d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:18.496740 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e11338b8-12fd-4bd0-86f0-7e35610d188d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:18.505176 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e11338b8-12fd-4bd0-86f0-7e35610d188d tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1551 microversion: 2.1 time: 0.162605 May 26 17:01:18.505739 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 214/402] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:18 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:18.814483 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9e410937-c431-499f-9aed-6adf2f29e780 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.544899 May 26 17:01:18.815325 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 189/403] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:01:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:01:18.815810 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a5fe2314-e8c3-4111-b88a-c65cd3401d6c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:18.816603 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a5fe2314-e8c3-4111-b88a-c65cd3401d6c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:18.823189 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a5fe2314-e8c3-4111-b88a-c65cd3401d6c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:18.823723 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a5fe2314-e8c3-4111-b88a-c65cd3401d6c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:18.824879 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a5fe2314-e8c3-4111-b88a-c65cd3401d6c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:18.825163 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a5fe2314-e8c3-4111-b88a-c65cd3401d6c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:18.825293 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-88693b91-21ac-4a3f-aec3-f5c89c983d65 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:18.825923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-88693b91-21ac-4a3f-aec3-f5c89c983d65 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:18.885242 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-88693b91-21ac-4a3f-aec3-f5c89c983d65 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:18.894294 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-88693b91-21ac-4a3f-aec3-f5c89c983d65 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1098 microversion: 2.1 time: 0.073097 May 26 17:01:18.904636 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 190/404] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:18 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1098 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:18.967214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a5fe2314-e8c3-4111-b88a-c65cd3401d6c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:18.975321 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a5fe2314-e8c3-4111-b88a-c65cd3401d6c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.163482 May 26 17:01:18.979807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 215/405] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:18 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:19.911965 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4a0e8079-1f9d-4ec8-85bd-da6574680a42 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:19.913161 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4a0e8079-1f9d-4ec8-85bd-da6574680a42 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:19.922050 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a0e8079-1f9d-4ec8-85bd-da6574680a42 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:19.922050 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a0e8079-1f9d-4ec8-85bd-da6574680a42 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:19.922267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a0e8079-1f9d-4ec8-85bd-da6574680a42 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:19.922627 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a0e8079-1f9d-4ec8-85bd-da6574680a42 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:19.987004 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4a0e8079-1f9d-4ec8-85bd-da6574680a42 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:19.993825 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-583113a9-93a4-45d2-9b75-c4c7f97f830d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:19.994553 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-583113a9-93a4-45d2-9b75-c4c7f97f830d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:19.994709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4a0e8079-1f9d-4ec8-85bd-da6574680a42 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1148 microversion: 2.1 time: 0.086835 May 26 17:01:19.995301 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 191/406] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:19 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1148 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:20.009817 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-583113a9-93a4-45d2-9b75-c4c7f97f830d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:20.010363 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-583113a9-93a4-45d2-9b75-c4c7f97f830d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:20.011204 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-583113a9-93a4-45d2-9b75-c4c7f97f830d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:20.011645 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-583113a9-93a4-45d2-9b75-c4c7f97f830d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:20.187385 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-583113a9-93a4-45d2-9b75-c4c7f97f830d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:20.195064 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-583113a9-93a4-45d2-9b75-c4c7f97f830d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.205222 May 26 17:01:20.205349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 216/407] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:19 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:21.010785 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d5039735-f8ec-4485-a684-89fde2a03500 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:21.011427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d5039735-f8ec-4485-a684-89fde2a03500 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:21.014263 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:21.019067 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d5039735-f8ec-4485-a684-89fde2a03500 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:21.019518 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d5039735-f8ec-4485-a684-89fde2a03500 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:21.020336 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d5039735-f8ec-4485-a684-89fde2a03500 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:21.020775 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d5039735-f8ec-4485-a684-89fde2a03500 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:21.085495 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d5039735-f8ec-4485-a684-89fde2a03500 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:21.093286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d5039735-f8ec-4485-a684-89fde2a03500 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1196 microversion: 2.1 time: 0.086314 May 26 17:01:21.093845 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 192/408] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:21 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1196 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:21.213603 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-97d0c07f-9e53-402b-b96b-9910b25859f7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:21.214463 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-97d0c07f-9e53-402b-b96b-9910b25859f7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:21.221617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-97d0c07f-9e53-402b-b96b-9910b25859f7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:21.222063 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-97d0c07f-9e53-402b-b96b-9910b25859f7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:21.222851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-97d0c07f-9e53-402b-b96b-9910b25859f7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:21.223275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-97d0c07f-9e53-402b-b96b-9910b25859f7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:21.355966 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-97d0c07f-9e53-402b-b96b-9910b25859f7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:21.365355 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-97d0c07f-9e53-402b-b96b-9910b25859f7 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.155730 May 26 17:01:21.366452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 217/409] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:21 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:21.597982 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ad84f756-0c2d-4454-bd09-af35b534faa2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9532b609-dcf3-4360-87af-f3c66640ca56"}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:21.599166 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ad84f756-0c2d-4454-bd09-af35b534faa2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:21.606478 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ad84f756-0c2d-4454-bd09-af35b534faa2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:21.606922 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ad84f756-0c2d-4454-bd09-af35b534faa2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:21.607684 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ad84f756-0c2d-4454-bd09-af35b534faa2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:21.608111 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ad84f756-0c2d-4454-bd09-af35b534faa2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:22.110809 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2fa6a400-856d-4b0b-8f98-53ee36468869 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:22.111455 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2fa6a400-856d-4b0b-8f98-53ee36468869 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:22.123608 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2fa6a400-856d-4b0b-8f98-53ee36468869 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:22.124068 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2fa6a400-856d-4b0b-8f98-53ee36468869 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:22.124836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2fa6a400-856d-4b0b-8f98-53ee36468869 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:22.125266 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2fa6a400-856d-4b0b-8f98-53ee36468869 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:22.198556 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2fa6a400-856d-4b0b-8f98-53ee36468869 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:22.207613 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2fa6a400-856d-4b0b-8f98-53ee36468869 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1214 microversion: 2.1 time: 0.100848 May 26 17:01:22.208186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 218/410] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:22 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:22.382488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bd9d59d2-570e-4d8f-bcfd-365d3f73ff53 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:22.383213 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bd9d59d2-570e-4d8f-bcfd-365d3f73ff53 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:22.389245 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bd9d59d2-570e-4d8f-bcfd-365d3f73ff53 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:22.389687 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bd9d59d2-570e-4d8f-bcfd-365d3f73ff53 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:22.390471 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bd9d59d2-570e-4d8f-bcfd-365d3f73ff53 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:22.390905 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bd9d59d2-570e-4d8f-bcfd-365d3f73ff53 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:22.554932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bd9d59d2-570e-4d8f-bcfd-365d3f73ff53 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:22.564692 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bd9d59d2-570e-4d8f-bcfd-365d3f73ff53 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.185932 May 26 17:01:22.565658 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 219/411] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:22 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:23.224060 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3158d42b-1166-47f4-b5a2-876b96b15ead tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:23.224669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3158d42b-1166-47f4-b5a2-876b96b15ead tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:23.226743 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=62 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:23.232331 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3158d42b-1166-47f4-b5a2-876b96b15ead tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:23.232903 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3158d42b-1166-47f4-b5a2-876b96b15ead tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:23.233672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3158d42b-1166-47f4-b5a2-876b96b15ead tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:23.234106 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3158d42b-1166-47f4-b5a2-876b96b15ead tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:23.283982 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ad84f756-0c2d-4454-bd09-af35b534faa2 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "POST /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.687641 May 26 17:01:23.283982 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 193/412] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:01:21 2022] POST /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments => generated 194 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:23.445402 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3158d42b-1166-47f4-b5a2-876b96b15ead tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:23.445402 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3158d42b-1166-47f4-b5a2-876b96b15ead tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1282 microversion: 2.1 time: 0.215890 May 26 17:01:23.445402 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 220/413] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:23 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1282 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:23.582821 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-49e8a770-2c70-4f72-9f1f-852db163b309 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:23.583788 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-49e8a770-2c70-4f72-9f1f-852db163b309 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:23.592557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-49e8a770-2c70-4f72-9f1f-852db163b309 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:23.593345 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-49e8a770-2c70-4f72-9f1f-852db163b309 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:23.595510 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-49e8a770-2c70-4f72-9f1f-852db163b309 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:23.595510 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-49e8a770-2c70-4f72-9f1f-852db163b309 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:23.614260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-34709a40-8f5f-443f-8979-d890bad0c4b8 req-3da4a109-b373-4f37-bc54-acb655b5e495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbd9cd4a-70e0-4506-b13a-39216e5b70c2", "tag": "c3b9d0aa-720f-4769-bd72-2f345752623b"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:23.627811 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-34709a40-8f5f-443f-8979-d890bad0c4b8 req-3da4a109-b373-4f37-bc54-acb655b5e495 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:23.631349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-34709a40-8f5f-443f-8979-d890bad0c4b8 req-3da4a109-b373-4f37-bc54-acb655b5e495 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:23.652836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-34709a40-8f5f-443f-8979-d890bad0c4b8 req-3da4a109-b373-4f37-bc54-acb655b5e495 service nova] Creating event network-changed:c3b9d0aa-720f-4769-bd72-2f345752623b for instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 on hv-cinder-83607 May 26 17:01:23.666239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-34709a40-8f5f-443f-8979-d890bad0c4b8 req-3da4a109-b373-4f37-bc54-acb655b5e495 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057124 May 26 17:01:23.672378 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 221/414] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:23.828061 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-49e8a770-2c70-4f72-9f1f-852db163b309 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:23.837331 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-49e8a770-2c70-4f72-9f1f-852db163b309 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.259332 May 26 17:01:23.837953 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 194/415] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:23 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:24.468741 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-831b1deb-a0df-4e30-a4df-7a65d2f6b874 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:24.469585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-831b1deb-a0df-4e30-a4df-7a65d2f6b874 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:24.476005 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-831b1deb-a0df-4e30-a4df-7a65d2f6b874 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:24.476451 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-831b1deb-a0df-4e30-a4df-7a65d2f6b874 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:24.477214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-831b1deb-a0df-4e30-a4df-7a65d2f6b874 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:24.477645 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-831b1deb-a0df-4e30-a4df-7a65d2f6b874 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:24.617474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-831b1deb-a0df-4e30-a4df-7a65d2f6b874 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:24.625487 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-831b1deb-a0df-4e30-a4df-7a65d2f6b874 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.161578 May 26 17:01:24.626062 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 222/416] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:24 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:24.856267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b57b46f2-7514-4da7-9151-187a9ff73ca2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:24.857126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b57b46f2-7514-4da7-9151-187a9ff73ca2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:24.863749 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b57b46f2-7514-4da7-9151-187a9ff73ca2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:24.864201 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b57b46f2-7514-4da7-9151-187a9ff73ca2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:24.864962 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b57b46f2-7514-4da7-9151-187a9ff73ca2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:24.865396 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b57b46f2-7514-4da7-9151-187a9ff73ca2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:24.995516 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b57b46f2-7514-4da7-9151-187a9ff73ca2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:25.004065 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b57b46f2-7514-4da7-9151-187a9ff73ca2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.151687 May 26 17:01:25.004629 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 195/417] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:24 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:25.649270 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d6882bce-0e01-4d7e-9122-e68c14f82443 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:25.649967 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d6882bce-0e01-4d7e-9122-e68c14f82443 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:25.657459 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d6882bce-0e01-4d7e-9122-e68c14f82443 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:25.657907 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d6882bce-0e01-4d7e-9122-e68c14f82443 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:25.658693 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d6882bce-0e01-4d7e-9122-e68c14f82443 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:25.659144 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d6882bce-0e01-4d7e-9122-e68c14f82443 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:25.823724 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d6882bce-0e01-4d7e-9122-e68c14f82443 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:25.837500 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d6882bce-0e01-4d7e-9122-e68c14f82443 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.197754 May 26 17:01:25.838540 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 223/418] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:25 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:26.024283 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c34c80fb-761b-4533-8b8e-6676cc2ae3c6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:26.031225 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c34c80fb-761b-4533-8b8e-6676cc2ae3c6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:26.032469 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c34c80fb-761b-4533-8b8e-6676cc2ae3c6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:26.032908 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c34c80fb-761b-4533-8b8e-6676cc2ae3c6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:26.033669 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c34c80fb-761b-4533-8b8e-6676cc2ae3c6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:26.034096 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c34c80fb-761b-4533-8b8e-6676cc2ae3c6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:26.175254 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c34c80fb-761b-4533-8b8e-6676cc2ae3c6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:26.183150 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c34c80fb-761b-4533-8b8e-6676cc2ae3c6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.165191 May 26 17:01:26.184218 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 196/419] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:26 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:26.858135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-02bed5a3-3ac4-4777-8f92-9dc3f4106cdb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:26.861817 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-02bed5a3-3ac4-4777-8f92-9dc3f4106cdb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:26.871780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02bed5a3-3ac4-4777-8f92-9dc3f4106cdb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:26.871780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02bed5a3-3ac4-4777-8f92-9dc3f4106cdb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:26.871780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02bed5a3-3ac4-4777-8f92-9dc3f4106cdb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:26.871780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02bed5a3-3ac4-4777-8f92-9dc3f4106cdb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:27.026287 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-02bed5a3-3ac4-4777-8f92-9dc3f4106cdb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:27.037556 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-02bed5a3-3ac4-4777-8f92-9dc3f4106cdb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.181931 May 26 17:01:27.037556 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 224/420] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:26 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:27.203036 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7e251819-113e-487b-aa23-89ba9aa42cf4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:27.203947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7e251819-113e-487b-aa23-89ba9aa42cf4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:27.211710 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7e251819-113e-487b-aa23-89ba9aa42cf4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:27.212255 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7e251819-113e-487b-aa23-89ba9aa42cf4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:27.213151 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7e251819-113e-487b-aa23-89ba9aa42cf4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:27.214110 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7e251819-113e-487b-aa23-89ba9aa42cf4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:27.396178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7e251819-113e-487b-aa23-89ba9aa42cf4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:27.404887 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7e251819-113e-487b-aa23-89ba9aa42cf4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.207397 May 26 17:01:27.405687 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 197/421] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:27 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:28.053226 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e8d15491-f591-4452-af04-a7f64603330a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:28.053828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e8d15491-f591-4452-af04-a7f64603330a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:28.060033 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8d15491-f591-4452-af04-a7f64603330a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:28.060478 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8d15491-f591-4452-af04-a7f64603330a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:28.061253 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8d15491-f591-4452-af04-a7f64603330a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:28.061693 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8d15491-f591-4452-af04-a7f64603330a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:28.179533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:28.198539 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e8d15491-f591-4452-af04-a7f64603330a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:28.206176 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e8d15491-f591-4452-af04-a7f64603330a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.157221 May 26 17:01:28.207265 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 225/422] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:28 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:28.422381 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b89ef63d-772c-4cc2-a6f1-de85812f14fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:28.422986 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b89ef63d-772c-4cc2-a6f1-de85812f14fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:28.425153 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:28.440967 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b89ef63d-772c-4cc2-a6f1-de85812f14fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:28.440967 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b89ef63d-772c-4cc2-a6f1-de85812f14fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:28.440967 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b89ef63d-772c-4cc2-a6f1-de85812f14fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:28.440967 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b89ef63d-772c-4cc2-a6f1-de85812f14fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:28.583313 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b89ef63d-772c-4cc2-a6f1-de85812f14fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:28.591887 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b89ef63d-772c-4cc2-a6f1-de85812f14fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.173965 May 26 17:01:28.592455 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 198/423] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:28 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:29.227775 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-642cd041-ad56-46f3-9cae-d20bc9184e89 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:29.228450 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-642cd041-ad56-46f3-9cae-d20bc9184e89 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:29.236285 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-642cd041-ad56-46f3-9cae-d20bc9184e89 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:29.236733 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-642cd041-ad56-46f3-9cae-d20bc9184e89 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:29.237499 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-642cd041-ad56-46f3-9cae-d20bc9184e89 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:29.237933 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-642cd041-ad56-46f3-9cae-d20bc9184e89 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:29.382627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-642cd041-ad56-46f3-9cae-d20bc9184e89 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:29.390571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-642cd041-ad56-46f3-9cae-d20bc9184e89 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.167445 May 26 17:01:29.391335 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 226/424] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:29 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:29.610901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-75d522a4-31bb-47da-9f7e-8e806f4a1949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:29.611536 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-75d522a4-31bb-47da-9f7e-8e806f4a1949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:29.613298 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=8 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:29.620353 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75d522a4-31bb-47da-9f7e-8e806f4a1949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:29.620844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75d522a4-31bb-47da-9f7e-8e806f4a1949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:29.621687 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75d522a4-31bb-47da-9f7e-8e806f4a1949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:29.622488 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75d522a4-31bb-47da-9f7e-8e806f4a1949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:29.762671 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-75d522a4-31bb-47da-9f7e-8e806f4a1949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:29.770258 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-75d522a4-31bb-47da-9f7e-8e806f4a1949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.164020 May 26 17:01:29.770873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 199/425] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:29 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:30.407191 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2edcbefd-3f25-4b10-a288-5def907e06e0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:30.407801 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2edcbefd-3f25-4b10-a288-5def907e06e0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:30.413893 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2edcbefd-3f25-4b10-a288-5def907e06e0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:30.414366 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2edcbefd-3f25-4b10-a288-5def907e06e0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:30.415133 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2edcbefd-3f25-4b10-a288-5def907e06e0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:30.415569 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2edcbefd-3f25-4b10-a288-5def907e06e0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:30.419952 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:30.562445 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2edcbefd-3f25-4b10-a288-5def907e06e0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:30.569952 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2edcbefd-3f25-4b10-a288-5def907e06e0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.166578 May 26 17:01:30.570638 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 227/426] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:30 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:30.790433 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b338245f-b417-40f0-a160-1f88290ebcea tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:30.790981 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b338245f-b417-40f0-a160-1f88290ebcea tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:30.799186 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b338245f-b417-40f0-a160-1f88290ebcea tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:30.799641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b338245f-b417-40f0-a160-1f88290ebcea tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:30.800421 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b338245f-b417-40f0-a160-1f88290ebcea tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:30.800870 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b338245f-b417-40f0-a160-1f88290ebcea tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:30.945730 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b338245f-b417-40f0-a160-1f88290ebcea tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:30.953498 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b338245f-b417-40f0-a160-1f88290ebcea tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.169759 May 26 17:01:30.954054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 200/427] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:30 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:31.587537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f564822c-f8af-42b3-a21b-ea46630ab4a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:31.588054 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f564822c-f8af-42b3-a21b-ea46630ab4a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:31.594680 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f564822c-f8af-42b3-a21b-ea46630ab4a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:31.595135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f564822c-f8af-42b3-a21b-ea46630ab4a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:31.595901 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f564822c-f8af-42b3-a21b-ea46630ab4a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:31.596337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f564822c-f8af-42b3-a21b-ea46630ab4a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:31.729871 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f564822c-f8af-42b3-a21b-ea46630ab4a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:31.737446 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f564822c-f8af-42b3-a21b-ea46630ab4a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.153814 May 26 17:01:31.738011 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 228/428] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:31 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:31.971277 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fbcf99ce-b35e-4058-acb9-9ea4f9b08224 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:31.971860 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fbcf99ce-b35e-4058-acb9-9ea4f9b08224 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:31.978402 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fbcf99ce-b35e-4058-acb9-9ea4f9b08224 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:31.978844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fbcf99ce-b35e-4058-acb9-9ea4f9b08224 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:31.979593 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fbcf99ce-b35e-4058-acb9-9ea4f9b08224 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:31.980020 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fbcf99ce-b35e-4058-acb9-9ea4f9b08224 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:32.114877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fbcf99ce-b35e-4058-acb9-9ea4f9b08224 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:32.122866 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fbcf99ce-b35e-4058-acb9-9ea4f9b08224 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.155675 May 26 17:01:32.123433 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 201/429] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:31 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:32.755343 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5a4fc7c0-4854-4f78-9658-6f90aa7754c8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:32.755940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5a4fc7c0-4854-4f78-9658-6f90aa7754c8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:32.762204 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5a4fc7c0-4854-4f78-9658-6f90aa7754c8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:32.762676 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5a4fc7c0-4854-4f78-9658-6f90aa7754c8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:32.763416 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5a4fc7c0-4854-4f78-9658-6f90aa7754c8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:32.763893 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5a4fc7c0-4854-4f78-9658-6f90aa7754c8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:32.895584 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5a4fc7c0-4854-4f78-9658-6f90aa7754c8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:32.903944 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5a4fc7c0-4854-4f78-9658-6f90aa7754c8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.152406 May 26 17:01:32.904989 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 229/430] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:32 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:33.140118 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4e2be535-dd08-4d1c-a2a8-577bf5c9497c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:33.140719 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4e2be535-dd08-4d1c-a2a8-577bf5c9497c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:33.147233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e2be535-dd08-4d1c-a2a8-577bf5c9497c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:33.147618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e2be535-dd08-4d1c-a2a8-577bf5c9497c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:33.148371 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e2be535-dd08-4d1c-a2a8-577bf5c9497c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:33.148805 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e2be535-dd08-4d1c-a2a8-577bf5c9497c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:33.282023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4e2be535-dd08-4d1c-a2a8-577bf5c9497c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:33.289557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4e2be535-dd08-4d1c-a2a8-577bf5c9497c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.154428 May 26 17:01:33.290125 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 202/431] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:33 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:33.925661 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d4d79366-26c3-4daa-af5a-b2de370bb3e9 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:33.926267 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d4d79366-26c3-4daa-af5a-b2de370bb3e9 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:33.932346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d4d79366-26c3-4daa-af5a-b2de370bb3e9 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:33.932791 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d4d79366-26c3-4daa-af5a-b2de370bb3e9 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:33.933547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d4d79366-26c3-4daa-af5a-b2de370bb3e9 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:33.934460 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d4d79366-26c3-4daa-af5a-b2de370bb3e9 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:34.067004 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d4d79366-26c3-4daa-af5a-b2de370bb3e9 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:34.074726 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d4d79366-26c3-4daa-af5a-b2de370bb3e9 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.152816 May 26 17:01:34.076702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 230/432] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:33 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:34.307216 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6117477b-40de-4871-8372-9d62387246f4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:34.307810 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6117477b-40de-4871-8372-9d62387246f4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:34.314385 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6117477b-40de-4871-8372-9d62387246f4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:34.314824 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6117477b-40de-4871-8372-9d62387246f4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:34.315577 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6117477b-40de-4871-8372-9d62387246f4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:34.316003 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6117477b-40de-4871-8372-9d62387246f4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:34.449196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6117477b-40de-4871-8372-9d62387246f4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:34.457312 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6117477b-40de-4871-8372-9d62387246f4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.153912 May 26 17:01:34.458070 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 203/433] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:34 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:35.092414 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-fe7c1b9e-6d72-449e-9f4f-425e59c6d314 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:35.093095 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-fe7c1b9e-6d72-449e-9f4f-425e59c6d314 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:35.099236 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fe7c1b9e-6d72-449e-9f4f-425e59c6d314 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:35.099690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fe7c1b9e-6d72-449e-9f4f-425e59c6d314 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:35.100449 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fe7c1b9e-6d72-449e-9f4f-425e59c6d314 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:35.100933 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fe7c1b9e-6d72-449e-9f4f-425e59c6d314 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:35.239165 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fe7c1b9e-6d72-449e-9f4f-425e59c6d314 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:35.246605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-fe7c1b9e-6d72-449e-9f4f-425e59c6d314 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.158717 May 26 17:01:35.248349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 231/434] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:35 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:35.475324 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3a0fc723-806c-4588-bc41-7d0bbac11fcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:35.475935 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3a0fc723-806c-4588-bc41-7d0bbac11fcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:35.483660 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3a0fc723-806c-4588-bc41-7d0bbac11fcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:35.484102 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3a0fc723-806c-4588-bc41-7d0bbac11fcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:35.484857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3a0fc723-806c-4588-bc41-7d0bbac11fcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:35.485290 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3a0fc723-806c-4588-bc41-7d0bbac11fcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:35.502449 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:35.616621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3a0fc723-806c-4588-bc41-7d0bbac11fcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:35.624037 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3a0fc723-806c-4588-bc41-7d0bbac11fcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.152544 May 26 17:01:35.624602 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 204/435] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:35 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:36.264911 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a0125482-b815-4a99-80d6-1ffcb4ff38a8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:36.265522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a0125482-b815-4a99-80d6-1ffcb4ff38a8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:36.271574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a0125482-b815-4a99-80d6-1ffcb4ff38a8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:36.272012 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a0125482-b815-4a99-80d6-1ffcb4ff38a8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:36.272784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a0125482-b815-4a99-80d6-1ffcb4ff38a8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:36.273210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a0125482-b815-4a99-80d6-1ffcb4ff38a8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:36.403835 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a0125482-b815-4a99-80d6-1ffcb4ff38a8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:36.411231 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a0125482-b815-4a99-80d6-1ffcb4ff38a8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.150738 May 26 17:01:36.411787 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 232/436] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:36 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:36.641494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1e6ca4fe-1303-4171-9ab0-57221f010e80 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:36.642118 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1e6ca4fe-1303-4171-9ab0-57221f010e80 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:36.648911 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1e6ca4fe-1303-4171-9ab0-57221f010e80 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:36.649393 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1e6ca4fe-1303-4171-9ab0-57221f010e80 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:36.650833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1e6ca4fe-1303-4171-9ab0-57221f010e80 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:36.651266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1e6ca4fe-1303-4171-9ab0-57221f010e80 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:36.783469 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1e6ca4fe-1303-4171-9ab0-57221f010e80 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:36.790856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1e6ca4fe-1303-4171-9ab0-57221f010e80 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.153860 May 26 17:01:36.791416 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 205/437] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:36 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:37.262233 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a6c80aeb-0ffd-4924-812b-b52b9acee611 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:37.262894 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a6c80aeb-0ffd-4924-812b-b52b9acee611 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:37.268849 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a6c80aeb-0ffd-4924-812b-b52b9acee611 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:37.269500 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a6c80aeb-0ffd-4924-812b-b52b9acee611 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:37.270123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a6c80aeb-0ffd-4924-812b-b52b9acee611 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:37.270576 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a6c80aeb-0ffd-4924-812b-b52b9acee611 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:37.409660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a6c80aeb-0ffd-4924-812b-b52b9acee611 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:37.418776 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a6c80aeb-0ffd-4924-812b-b52b9acee611 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1597 microversion: 2.1 time: 0.160623 May 26 17:01:37.419767 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 233/438] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:37 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1597 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:37.428080 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fdadfb88-8851-4798-ba69-125437f182a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:37.428806 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fdadfb88-8851-4798-ba69-125437f182a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:37.435851 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fdadfb88-8851-4798-ba69-125437f182a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:37.436306 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fdadfb88-8851-4798-ba69-125437f182a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:37.437104 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fdadfb88-8851-4798-ba69-125437f182a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:37.437584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fdadfb88-8851-4798-ba69-125437f182a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:37.588492 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fdadfb88-8851-4798-ba69-125437f182a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:37.597317 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fdadfb88-8851-4798-ba69-125437f182a5 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.173190 May 26 17:01:37.598123 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 206/439] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:37 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:37.808275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-eec8b62d-7a6e-48ab-9e6a-1b3d403a942a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:37.808885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-eec8b62d-7a6e-48ab-9e6a-1b3d403a942a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:37.815768 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eec8b62d-7a6e-48ab-9e6a-1b3d403a942a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:37.816218 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eec8b62d-7a6e-48ab-9e6a-1b3d403a942a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:37.816990 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eec8b62d-7a6e-48ab-9e6a-1b3d403a942a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:37.817428 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eec8b62d-7a6e-48ab-9e6a-1b3d403a942a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:37.966246 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-eec8b62d-7a6e-48ab-9e6a-1b3d403a942a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:37.973779 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-eec8b62d-7a6e-48ab-9e6a-1b3d403a942a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.169368 May 26 17:01:37.974369 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 234/440] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:37 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:38.614198 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e283ea04-8346-400a-9eae-8014b1b6c003 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:38.614903 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e283ea04-8346-400a-9eae-8014b1b6c003 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:38.621508 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e283ea04-8346-400a-9eae-8014b1b6c003 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:38.622018 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e283ea04-8346-400a-9eae-8014b1b6c003 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:38.622887 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e283ea04-8346-400a-9eae-8014b1b6c003 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:38.623323 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e283ea04-8346-400a-9eae-8014b1b6c003 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:38.858469 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e283ea04-8346-400a-9eae-8014b1b6c003 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:38.866575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e283ea04-8346-400a-9eae-8014b1b6c003 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.256125 May 26 17:01:38.867231 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 207/441] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:38 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:38.991698 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e90b1aef-652b-42e8-93c5-1257de326f8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:38.992296 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e90b1aef-652b-42e8-93c5-1257de326f8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:39.000800 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e90b1aef-652b-42e8-93c5-1257de326f8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:39.001340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e90b1aef-652b-42e8-93c5-1257de326f8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:39.002288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e90b1aef-652b-42e8-93c5-1257de326f8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:39.002754 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e90b1aef-652b-42e8-93c5-1257de326f8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:39.140219 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e90b1aef-652b-42e8-93c5-1257de326f8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:39.151350 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e90b1aef-652b-42e8-93c5-1257de326f8c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.163258 May 26 17:01:39.151977 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 235/442] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:38 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:39.884530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-97ac8682-1241-4114-8ab0-313f72c5a17d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:39.885125 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-97ac8682-1241-4114-8ab0-313f72c5a17d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:39.892987 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-97ac8682-1241-4114-8ab0-313f72c5a17d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:39.893455 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-97ac8682-1241-4114-8ab0-313f72c5a17d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:39.894231 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-97ac8682-1241-4114-8ab0-313f72c5a17d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:39.894800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-97ac8682-1241-4114-8ab0-313f72c5a17d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:40.024429 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-96ce4a01-5266-494b-8136-1b47f57dbc52 req-7677e126-faf2-437d-873f-832d0ad9f432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d526ee14-28c1-46f0-97e9-37aecfc19059", "tag": "8f683af9-2af5-45b8-b6cb-ef44b939789d"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:40.043500 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-96ce4a01-5266-494b-8136-1b47f57dbc52 req-7677e126-faf2-437d-873f-832d0ad9f432 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:40.045794 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-96ce4a01-5266-494b-8136-1b47f57dbc52 req-7677e126-faf2-437d-873f-832d0ad9f432 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:40.074006 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-96ce4a01-5266-494b-8136-1b47f57dbc52 req-7677e126-faf2-437d-873f-832d0ad9f432 service nova] Creating event network-changed:8f683af9-2af5-45b8-b6cb-ef44b939789d for instance d526ee14-28c1-46f0-97e9-37aecfc19059 on hv-cinder-83607 May 26 17:01:40.075947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-97ac8682-1241-4114-8ab0-313f72c5a17d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:40.080982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-96ce4a01-5266-494b-8136-1b47f57dbc52 req-7677e126-faf2-437d-873f-832d0ad9f432 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066430 May 26 17:01:40.082600 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 236/443] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:40.085005 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-97ac8682-1241-4114-8ab0-313f72c5a17d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.204166 May 26 17:01:40.092308 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 208/444] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:39 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:40.169205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2773acfc-cdaf-4d40-9edf-4fcc0e40c676 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:40.181021 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2773acfc-cdaf-4d40-9edf-4fcc0e40c676 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:40.189390 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2773acfc-cdaf-4d40-9edf-4fcc0e40c676 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:40.189850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2773acfc-cdaf-4d40-9edf-4fcc0e40c676 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:40.190675 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2773acfc-cdaf-4d40-9edf-4fcc0e40c676 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:40.191126 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2773acfc-cdaf-4d40-9edf-4fcc0e40c676 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:40.373876 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2773acfc-cdaf-4d40-9edf-4fcc0e40c676 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:40.385238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2773acfc-cdaf-4d40-9edf-4fcc0e40c676 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.219683 May 26 17:01:40.386567 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 237/445] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:40 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:40.483989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-9b74bd1b-d8ca-4180-840d-57f969d52e42 req-1234055d-aa0b-404e-b973-c9aee1948467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd9cd4a-70e0-4506-b13a-39216e5b70c2", "name": "network-vif-plugged", "status": "completed", "tag": "c3b9d0aa-720f-4769-bd72-2f345752623b"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:40.492892 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-9b74bd1b-d8ca-4180-840d-57f969d52e42 req-1234055d-aa0b-404e-b973-c9aee1948467 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:40.493349 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-9b74bd1b-d8ca-4180-840d-57f969d52e42 req-1234055d-aa0b-404e-b973-c9aee1948467 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:40.507656 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-9b74bd1b-d8ca-4180-840d-57f969d52e42 req-1234055d-aa0b-404e-b973-c9aee1948467 service nova] Creating event network-vif-plugged:c3b9d0aa-720f-4769-bd72-2f345752623b for instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 on hv-cinder-83607 May 26 17:01:40.511508 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-9b74bd1b-d8ca-4180-840d-57f969d52e42 req-1234055d-aa0b-404e-b973-c9aee1948467 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031999 May 26 17:01:40.512129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 209/446] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:41.102118 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8d9a51b3-03cb-4dee-b927-c3ffd19db54b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:41.102751 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8d9a51b3-03cb-4dee-b927-c3ffd19db54b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:41.109488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8d9a51b3-03cb-4dee-b927-c3ffd19db54b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:41.109937 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8d9a51b3-03cb-4dee-b927-c3ffd19db54b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:41.110728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8d9a51b3-03cb-4dee-b927-c3ffd19db54b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:41.111169 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8d9a51b3-03cb-4dee-b927-c3ffd19db54b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:41.272000 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8d9a51b3-03cb-4dee-b927-c3ffd19db54b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:41.279904 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8d9a51b3-03cb-4dee-b927-c3ffd19db54b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.181617 May 26 17:01:41.280464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 238/447] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:41 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:41.403905 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-61730f26-eaa5-4683-ba98-935adea724e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:41.404892 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-61730f26-eaa5-4683-ba98-935adea724e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:41.412343 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-61730f26-eaa5-4683-ba98-935adea724e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:41.413454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-61730f26-eaa5-4683-ba98-935adea724e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:41.414353 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-61730f26-eaa5-4683-ba98-935adea724e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:41.415044 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-61730f26-eaa5-4683-ba98-935adea724e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:41.560709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-61730f26-eaa5-4683-ba98-935adea724e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:41.568197 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-61730f26-eaa5-4683-ba98-935adea724e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1527 microversion: 2.1 time: 0.169142 May 26 17:01:41.568686 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 210/448] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:41 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1527 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:42.297578 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-aa6a6b14-224f-406a-9fd4-5b1a7fd89515 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:42.298196 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-aa6a6b14-224f-406a-9fd4-5b1a7fd89515 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:42.304556 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aa6a6b14-224f-406a-9fd4-5b1a7fd89515 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.305005 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aa6a6b14-224f-406a-9fd4-5b1a7fd89515 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:42.305780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aa6a6b14-224f-406a-9fd4-5b1a7fd89515 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.306217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aa6a6b14-224f-406a-9fd4-5b1a7fd89515 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:42.457684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-aa6a6b14-224f-406a-9fd4-5b1a7fd89515 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:42.465185 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-aa6a6b14-224f-406a-9fd4-5b1a7fd89515 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.172389 May 26 17:01:42.468325 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 239/449] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:42 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:42.585290 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-279414c7-5933-4437-b96d-718c37a8e444 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:42.585900 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-279414c7-5933-4437-b96d-718c37a8e444 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:42.593271 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-279414c7-5933-4437-b96d-718c37a8e444 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.593605 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-279414c7-5933-4437-b96d-718c37a8e444 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:42.594419 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-279414c7-5933-4437-b96d-718c37a8e444 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.594854 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-279414c7-5933-4437-b96d-718c37a8e444 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:42.728989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-279414c7-5933-4437-b96d-718c37a8e444 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:42.737190 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-279414c7-5933-4437-b96d-718c37a8e444 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1507 microversion: 2.1 time: 0.155974 May 26 17:01:42.737736 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 211/450] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:42 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:42.752800 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6c4f9a41-db66-420b-93b8-457397b0ae92 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:42.753401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6c4f9a41-db66-420b-93b8-457397b0ae92 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:42.759312 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6c4f9a41-db66-420b-93b8-457397b0ae92 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.759761 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6c4f9a41-db66-420b-93b8-457397b0ae92 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:42.760516 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6c4f9a41-db66-420b-93b8-457397b0ae92 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.760951 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6c4f9a41-db66-420b-93b8-457397b0ae92 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:42.832131 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-11d4d23f-50a0-4efe-96ca-663c62a0c3ec tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-657202360"}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:42.833351 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-11d4d23f-50a0-4efe-96ca-663c62a0c3ec tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:42.839991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-11d4d23f-50a0-4efe-96ca-663c62a0c3ec tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.841384 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-11d4d23f-50a0-4efe-96ca-663c62a0c3ec tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:42.842281 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-11d4d23f-50a0-4efe-96ca-663c62a0c3ec tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.842738 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-11d4d23f-50a0-4efe-96ca-663c62a0c3ec tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:42.904074 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6c4f9a41-db66-420b-93b8-457397b0ae92 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:42.921776 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6c4f9a41-db66-420b-93b8-457397b0ae92 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1519 microversion: 2.1 time: 0.171823 May 26 17:01:42.921776 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 240/451] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:42 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:42.973217 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.network.security_group_api [None req-11d4d23f-50a0-4efe-96ca-663c62a0c3ec tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Adding security group 591bca03-0a6d-4e79-9610-096015b4a9c4 to port 8f683af9-2af5-45b8-b6cb-ef44b939789d May 26 17:01:43.483777 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-561e2bcc-6d91-4bd5-ae8f-1d05eef2bf11 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:43.484484 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-561e2bcc-6d91-4bd5-ae8f-1d05eef2bf11 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:43.490505 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-561e2bcc-6d91-4bd5-ae8f-1d05eef2bf11 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:43.490956 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-561e2bcc-6d91-4bd5-ae8f-1d05eef2bf11 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:43.491717 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-561e2bcc-6d91-4bd5-ae8f-1d05eef2bf11 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:43.492155 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-561e2bcc-6d91-4bd5-ae8f-1d05eef2bf11 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:43.515942 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-11d4d23f-50a0-4efe-96ca-663c62a0c3ec tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "POST /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/action" status: 202 len: 0 microversion: 2.1 time: 0.687850 May 26 17:01:43.521341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 212/452] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:01:42 2022] POST /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:01:43.525926 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-0012eed7-26d6-4ddc-bef2-136adf714583 req-01ebddb7-1c79-4b00-95d6-a674bf334e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d526ee14-28c1-46f0-97e9-37aecfc19059", "tag": "8f683af9-2af5-45b8-b6cb-ef44b939789d"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:43.536355 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-0012eed7-26d6-4ddc-bef2-136adf714583 req-01ebddb7-1c79-4b00-95d6-a674bf334e63 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:43.536804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-0012eed7-26d6-4ddc-bef2-136adf714583 req-01ebddb7-1c79-4b00-95d6-a674bf334e63 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:43.562420 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-0012eed7-26d6-4ddc-bef2-136adf714583 req-01ebddb7-1c79-4b00-95d6-a674bf334e63 service nova] Creating event network-changed:8f683af9-2af5-45b8-b6cb-ef44b939789d for instance d526ee14-28c1-46f0-97e9-37aecfc19059 on hv-cinder-83607 May 26 17:01:43.567939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-0012eed7-26d6-4ddc-bef2-136adf714583 req-01ebddb7-1c79-4b00-95d6-a674bf334e63 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046461 May 26 17:01:43.568468 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 213/453] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:43.583054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4444edd1-e4dd-4d46-8be1-25160762e9d4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:43.583765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4444edd1-e4dd-4d46-8be1-25160762e9d4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:43.593291 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4444edd1-e4dd-4d46-8be1-25160762e9d4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:43.593910 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4444edd1-e4dd-4d46-8be1-25160762e9d4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:43.594628 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4444edd1-e4dd-4d46-8be1-25160762e9d4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:43.595324 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4444edd1-e4dd-4d46-8be1-25160762e9d4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:43.738273 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-561e2bcc-6d91-4bd5-ae8f-1d05eef2bf11 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:43.752708 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-561e2bcc-6d91-4bd5-ae8f-1d05eef2bf11 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.273736 May 26 17:01:43.754580 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 241/454] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:43 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:43.789636 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4444edd1-e4dd-4d46-8be1-25160762e9d4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:43.797709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4444edd1-e4dd-4d46-8be1-25160762e9d4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1761 microversion: 2.1 time: 0.220270 May 26 17:01:43.798291 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 214/455] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:43 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1761 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:44.771291 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1e2aff76-3c32-4e59-8a46-dc14eaf4aa2b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:44.771900 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1e2aff76-3c32-4e59-8a46-dc14eaf4aa2b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:44.778541 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1e2aff76-3c32-4e59-8a46-dc14eaf4aa2b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:44.779101 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1e2aff76-3c32-4e59-8a46-dc14eaf4aa2b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:44.779954 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1e2aff76-3c32-4e59-8a46-dc14eaf4aa2b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:44.780387 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1e2aff76-3c32-4e59-8a46-dc14eaf4aa2b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:44.911647 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1e2aff76-3c32-4e59-8a46-dc14eaf4aa2b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:44.919742 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1e2aff76-3c32-4e59-8a46-dc14eaf4aa2b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1270 microversion: 2.1 time: 0.152215 May 26 17:01:44.920311 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 242/456] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:44 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:45.788709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c1517a8b-9814-4e8e-8576-4ec0115e08ed tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:45.789645 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c1517a8b-9814-4e8e-8576-4ec0115e08ed tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:45.796707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c1517a8b-9814-4e8e-8576-4ec0115e08ed tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:45.797151 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c1517a8b-9814-4e8e-8576-4ec0115e08ed tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:45.797939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c1517a8b-9814-4e8e-8576-4ec0115e08ed tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:45.798457 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c1517a8b-9814-4e8e-8576-4ec0115e08ed tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:45.821273 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-c1517a8b-9814-4e8e-8576-4ec0115e08ed tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lazy-loading 'flavor' on Instance uuid bf36dc82-736a-4235-a29d-663f9341ab63 {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:01:45.936918 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b9528bdb-229e-4fc5-b563-c610d4467fb7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:45.937525 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b9528bdb-229e-4fc5-b563-c610d4467fb7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:45.943439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b9528bdb-229e-4fc5-b563-c610d4467fb7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:45.943888 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b9528bdb-229e-4fc5-b563-c610d4467fb7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:45.944641 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b9528bdb-229e-4fc5-b563-c610d4467fb7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:45.945072 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b9528bdb-229e-4fc5-b563-c610d4467fb7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:46.080843 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b9528bdb-229e-4fc5-b563-c610d4467fb7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:46.088765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b9528bdb-229e-4fc5-b563-c610d4467fb7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1457 microversion: 2.1 time: 0.156413 May 26 17:01:46.089324 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 243/457] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:45 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1457 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:46.105875 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7c08fb8c-b464-4752-b447-4fbc9299224a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:46.106672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7c08fb8c-b464-4752-b447-4fbc9299224a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:46.113522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c08fb8c-b464-4752-b447-4fbc9299224a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:46.113964 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c08fb8c-b464-4752-b447-4fbc9299224a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:46.114741 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c08fb8c-b464-4752-b447-4fbc9299224a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:46.115169 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c08fb8c-b464-4752-b447-4fbc9299224a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:46.133124 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:46.193009 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c1517a8b-9814-4e8e-8576-4ec0115e08ed tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "POST /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63/action" status: 200 len: 32 microversion: 2.1 time: 0.408175 May 26 17:01:46.193655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 215/458] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:01:45 2022] POST /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63/action => generated 32 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:01:46.203324 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a93b0975-df80-40b5-b9a3-faa0066e5949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:46.204014 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a93b0975-df80-40b5-b9a3-faa0066e5949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:46.211171 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a93b0975-df80-40b5-b9a3-faa0066e5949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:46.211576 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a93b0975-df80-40b5-b9a3-faa0066e5949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:46.212341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a93b0975-df80-40b5-b9a3-faa0066e5949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:46.212770 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a93b0975-df80-40b5-b9a3-faa0066e5949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:46.251348 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7c08fb8c-b464-4752-b447-4fbc9299224a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:46.259559 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7c08fb8c-b464-4752-b447-4fbc9299224a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1457 microversion: 2.1 time: 0.157379 May 26 17:01:46.260144 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 244/459] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:46 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1457 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:46.347213 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a93b0975-df80-40b5-b9a3-faa0066e5949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:46.354688 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a93b0975-df80-40b5-b9a3-faa0066e5949 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.155791 May 26 17:01:46.355273 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 216/460] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:46 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:47.373613 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3e8fe82f-14e7-44c2-9b2f-a73c188124fd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:47.374914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3e8fe82f-14e7-44c2-9b2f-a73c188124fd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:47.381469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3e8fe82f-14e7-44c2-9b2f-a73c188124fd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:47.381924 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3e8fe82f-14e7-44c2-9b2f-a73c188124fd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:47.382723 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3e8fe82f-14e7-44c2-9b2f-a73c188124fd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:47.383156 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3e8fe82f-14e7-44c2-9b2f-a73c188124fd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:47.558134 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3e8fe82f-14e7-44c2-9b2f-a73c188124fd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:47.566084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3e8fe82f-14e7-44c2-9b2f-a73c188124fd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.197630 May 26 17:01:47.566705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 245/461] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:47 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:48.559892 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-6adbff8c-446b-4d14-a07c-3de4120ae01c req-b83baf1c-685a-4d9b-a46a-fea3c569abc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbd9cd4a-70e0-4506-b13a-39216e5b70c2", "tag": "c3b9d0aa-720f-4769-bd72-2f345752623b"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:48.569442 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-6adbff8c-446b-4d14-a07c-3de4120ae01c req-b83baf1c-685a-4d9b-a46a-fea3c569abc7 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:48.569967 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-6adbff8c-446b-4d14-a07c-3de4120ae01c req-b83baf1c-685a-4d9b-a46a-fea3c569abc7 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:48.584601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1281cc05-4734-41d0-89f9-d2a15997f689 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:48.585191 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-6adbff8c-446b-4d14-a07c-3de4120ae01c req-b83baf1c-685a-4d9b-a46a-fea3c569abc7 service nova] Creating event network-changed:c3b9d0aa-720f-4769-bd72-2f345752623b for instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 on hv-cinder-83607 May 26 17:01:48.586354 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1281cc05-4734-41d0-89f9-d2a15997f689 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:48.591512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-6adbff8c-446b-4d14-a07c-3de4120ae01c req-b83baf1c-685a-4d9b-a46a-fea3c569abc7 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036761 May 26 17:01:48.598589 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1281cc05-4734-41d0-89f9-d2a15997f689 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:48.598715 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 217/462] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:48.598816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1281cc05-4734-41d0-89f9-d2a15997f689 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:48.598816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1281cc05-4734-41d0-89f9-d2a15997f689 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:48.598816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1281cc05-4734-41d0-89f9-d2a15997f689 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:48.743595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1281cc05-4734-41d0-89f9-d2a15997f689 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:48.751499 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1281cc05-4734-41d0-89f9-d2a15997f689 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.172201 May 26 17:01:48.752075 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 246/463] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:48 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:49.770494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-40b160b8-e9fd-4096-8b6d-e51b1a235354 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:49.771116 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-40b160b8-e9fd-4096-8b6d-e51b1a235354 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:49.777867 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-40b160b8-e9fd-4096-8b6d-e51b1a235354 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:49.779248 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-40b160b8-e9fd-4096-8b6d-e51b1a235354 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:49.779731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-40b160b8-e9fd-4096-8b6d-e51b1a235354 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:49.780166 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-40b160b8-e9fd-4096-8b6d-e51b1a235354 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:49.921349 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-40b160b8-e9fd-4096-8b6d-e51b1a235354 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:49.928803 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-40b160b8-e9fd-4096-8b6d-e51b1a235354 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.162558 May 26 17:01:49.929909 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 218/464] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:49 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:50.945665 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-fdf8caa4-7c51-4f20-b42c-deb6c408025f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:50.946297 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-fdf8caa4-7c51-4f20-b42c-deb6c408025f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:50.952397 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fdf8caa4-7c51-4f20-b42c-deb6c408025f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:50.952846 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fdf8caa4-7c51-4f20-b42c-deb6c408025f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:50.953603 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fdf8caa4-7c51-4f20-b42c-deb6c408025f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:50.954042 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fdf8caa4-7c51-4f20-b42c-deb6c408025f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:51.086946 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fdf8caa4-7c51-4f20-b42c-deb6c408025f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:51.095240 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-fdf8caa4-7c51-4f20-b42c-deb6c408025f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.153389 May 26 17:01:51.095869 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 247/465] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:50 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:52.113037 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f370e66b-ba47-4e4a-9ca6-2c284a10d6d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:52.113650 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f370e66b-ba47-4e4a-9ca6-2c284a10d6d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:52.116068 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=54 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:52.120901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f370e66b-ba47-4e4a-9ca6-2c284a10d6d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:52.121354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f370e66b-ba47-4e4a-9ca6-2c284a10d6d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:52.122864 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f370e66b-ba47-4e4a-9ca6-2c284a10d6d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:52.123314 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f370e66b-ba47-4e4a-9ca6-2c284a10d6d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:52.253333 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f370e66b-ba47-4e4a-9ca6-2c284a10d6d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:52.260868 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f370e66b-ba47-4e4a-9ca6-2c284a10d6d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.151704 May 26 17:01:52.261956 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 219/466] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:52 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:53.280846 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-57ba93fb-9614-4165-9133-4e5b3fe32bf2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:53.281630 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-57ba93fb-9614-4165-9133-4e5b3fe32bf2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:53.288879 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-57ba93fb-9614-4165-9133-4e5b3fe32bf2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:53.289586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-57ba93fb-9614-4165-9133-4e5b3fe32bf2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:53.290462 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-57ba93fb-9614-4165-9133-4e5b3fe32bf2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:53.291265 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-57ba93fb-9614-4165-9133-4e5b3fe32bf2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:53.636084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-57ba93fb-9614-4165-9133-4e5b3fe32bf2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:53.645837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-57ba93fb-9614-4165-9133-4e5b3fe32bf2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.371092 May 26 17:01:53.646542 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 248/467] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:53 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:54.664979 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a8e2e9f2-0bcd-4e04-b395-84f5229d48ee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:54.665660 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a8e2e9f2-0bcd-4e04-b395-84f5229d48ee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:54.672301 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a8e2e9f2-0bcd-4e04-b395-84f5229d48ee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:54.672775 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a8e2e9f2-0bcd-4e04-b395-84f5229d48ee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:54.673536 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a8e2e9f2-0bcd-4e04-b395-84f5229d48ee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:54.673970 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a8e2e9f2-0bcd-4e04-b395-84f5229d48ee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:54.806101 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a8e2e9f2-0bcd-4e04-b395-84f5229d48ee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:54.814295 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a8e2e9f2-0bcd-4e04-b395-84f5229d48ee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.153193 May 26 17:01:54.814882 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 220/468] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:54 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:55.832985 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5f9c73f4-845a-4492-aa8a-175edde8659e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:55.833519 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5f9c73f4-845a-4492-aa8a-175edde8659e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:55.835397 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=58 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:55.840121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5f9c73f4-845a-4492-aa8a-175edde8659e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:55.841261 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5f9c73f4-845a-4492-aa8a-175edde8659e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:55.842040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5f9c73f4-845a-4492-aa8a-175edde8659e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:55.842514 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5f9c73f4-845a-4492-aa8a-175edde8659e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:55.976320 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5f9c73f4-845a-4492-aa8a-175edde8659e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:55.984549 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5f9c73f4-845a-4492-aa8a-175edde8659e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.157074 May 26 17:01:55.985107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 249/469] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:55 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:57.001903 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-78864bed-d444-4139-a567-516ee51d09d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:57.002468 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-78864bed-d444-4139-a567-516ee51d09d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:57.009077 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-78864bed-d444-4139-a567-516ee51d09d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:57.009523 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-78864bed-d444-4139-a567-516ee51d09d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:57.010278 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-78864bed-d444-4139-a567-516ee51d09d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:57.010739 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-78864bed-d444-4139-a567-516ee51d09d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:57.025699 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:57.143080 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-78864bed-d444-4139-a567-516ee51d09d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:57.151444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-78864bed-d444-4139-a567-516ee51d09d4 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.153614 May 26 17:01:57.152115 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 221/470] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:56 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:58.169258 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-02baa236-57cf-4dcb-bdd2-0981bd382a21 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:58.169856 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-02baa236-57cf-4dcb-bdd2-0981bd382a21 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:58.175809 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02baa236-57cf-4dcb-bdd2-0981bd382a21 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:58.176244 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02baa236-57cf-4dcb-bdd2-0981bd382a21 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:58.176999 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02baa236-57cf-4dcb-bdd2-0981bd382a21 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:58.177423 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02baa236-57cf-4dcb-bdd2-0981bd382a21 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:58.310131 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-02baa236-57cf-4dcb-bdd2-0981bd382a21 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:58.317845 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-02baa236-57cf-4dcb-bdd2-0981bd382a21 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.152854 May 26 17:01:58.318435 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 250/471] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:58 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:59.335132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7aadc8ba-24f0-42f3-859f-f78b1c410088 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:59.335677 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7aadc8ba-24f0-42f3-859f-f78b1c410088 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:59.342833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7aadc8ba-24f0-42f3-859f-f78b1c410088 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:59.343283 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7aadc8ba-24f0-42f3-859f-f78b1c410088 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:59.344058 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7aadc8ba-24f0-42f3-859f-f78b1c410088 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:59.344494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7aadc8ba-24f0-42f3-859f-f78b1c410088 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:59.475528 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7aadc8ba-24f0-42f3-859f-f78b1c410088 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:59.482998 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7aadc8ba-24f0-42f3-859f-f78b1c410088 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.152126 May 26 17:01:59.483614 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 222/472] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:01:59 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:00.501002 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ee3bf685-87cf-49d3-920b-c0d4e93618d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:00.501607 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ee3bf685-87cf-49d3-920b-c0d4e93618d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:00.507795 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee3bf685-87cf-49d3-920b-c0d4e93618d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:00.508250 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee3bf685-87cf-49d3-920b-c0d4e93618d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:00.509035 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee3bf685-87cf-49d3-920b-c0d4e93618d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:00.509465 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee3bf685-87cf-49d3-920b-c0d4e93618d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:00.636260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ee3bf685-87cf-49d3-920b-c0d4e93618d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:00.644347 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ee3bf685-87cf-49d3-920b-c0d4e93618d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.147758 May 26 17:02:00.644918 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 251/473] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:00 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:01.661804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-36a2bdcb-1b52-42ab-8b1d-19ba51c701d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:01.662440 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-36a2bdcb-1b52-42ab-8b1d-19ba51c701d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:01.669839 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-36a2bdcb-1b52-42ab-8b1d-19ba51c701d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:01.670302 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-36a2bdcb-1b52-42ab-8b1d-19ba51c701d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:01.671085 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-36a2bdcb-1b52-42ab-8b1d-19ba51c701d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:01.671663 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-36a2bdcb-1b52-42ab-8b1d-19ba51c701d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:01.806858 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-36a2bdcb-1b52-42ab-8b1d-19ba51c701d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:01.815439 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-36a2bdcb-1b52-42ab-8b1d-19ba51c701d6 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.157562 May 26 17:02:01.816013 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 223/474] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:01 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:02.833027 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-51a6fd99-4bd0-4868-931a-6e98d008054a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:02.833629 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-51a6fd99-4bd0-4868-931a-6e98d008054a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:02.839663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-51a6fd99-4bd0-4868-931a-6e98d008054a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:02.840910 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-51a6fd99-4bd0-4868-931a-6e98d008054a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:02.841683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-51a6fd99-4bd0-4868-931a-6e98d008054a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:02.842112 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-51a6fd99-4bd0-4868-931a-6e98d008054a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:02.981395 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-51a6fd99-4bd0-4868-931a-6e98d008054a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:02.991195 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-51a6fd99-4bd0-4868-931a-6e98d008054a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.162003 May 26 17:02:02.991777 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 252/475] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:02 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:04.008976 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-03d12182-752e-41d1-9872-55ea7d39c958 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:04.009585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-03d12182-752e-41d1-9872-55ea7d39c958 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:04.017054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03d12182-752e-41d1-9872-55ea7d39c958 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:04.017505 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03d12182-752e-41d1-9872-55ea7d39c958 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:04.018278 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03d12182-752e-41d1-9872-55ea7d39c958 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:04.018740 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03d12182-752e-41d1-9872-55ea7d39c958 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:04.155155 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-03d12182-752e-41d1-9872-55ea7d39c958 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:04.162665 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-03d12182-752e-41d1-9872-55ea7d39c958 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.157564 May 26 17:02:04.163232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 224/476] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:04 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:05.179368 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1ffa59c8-c990-438f-8972-d1caab47a80e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:05.179956 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1ffa59c8-c990-438f-8972-d1caab47a80e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:05.186590 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1ffa59c8-c990-438f-8972-d1caab47a80e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:05.187033 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1ffa59c8-c990-438f-8972-d1caab47a80e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:05.187798 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1ffa59c8-c990-438f-8972-d1caab47a80e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:05.188223 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1ffa59c8-c990-438f-8972-d1caab47a80e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:05.323379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1ffa59c8-c990-438f-8972-d1caab47a80e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:05.331873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1ffa59c8-c990-438f-8972-d1caab47a80e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.156355 May 26 17:02:05.332734 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 253/477] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:05 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:06.350166 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9085d404-b639-42d8-bd87-221af182de09 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:06.351509 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9085d404-b639-42d8-bd87-221af182de09 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:06.358131 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9085d404-b639-42d8-bd87-221af182de09 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:06.358602 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9085d404-b639-42d8-bd87-221af182de09 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:06.359425 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9085d404-b639-42d8-bd87-221af182de09 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:06.359804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9085d404-b639-42d8-bd87-221af182de09 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:06.496440 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9085d404-b639-42d8-bd87-221af182de09 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:06.504184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9085d404-b639-42d8-bd87-221af182de09 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.157895 May 26 17:02:06.505714 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 225/478] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:06 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:07.523505 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-27accf7c-5b44-4f92-b306-9615acf5de07 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:07.524049 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-27accf7c-5b44-4f92-b306-9615acf5de07 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:07.531410 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-27accf7c-5b44-4f92-b306-9615acf5de07 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:07.531856 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-27accf7c-5b44-4f92-b306-9615acf5de07 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:07.532618 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-27accf7c-5b44-4f92-b306-9615acf5de07 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:07.533051 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-27accf7c-5b44-4f92-b306-9615acf5de07 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:07.667272 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-27accf7c-5b44-4f92-b306-9615acf5de07 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:07.674831 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-27accf7c-5b44-4f92-b306-9615acf5de07 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.155346 May 26 17:02:07.675395 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 254/479] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:07 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:08.692549 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5f0b76b2-117b-4975-9e6d-240aee5d9e17 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:08.693172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5f0b76b2-117b-4975-9e6d-240aee5d9e17 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:08.699804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5f0b76b2-117b-4975-9e6d-240aee5d9e17 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:08.700299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5f0b76b2-117b-4975-9e6d-240aee5d9e17 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:08.701079 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5f0b76b2-117b-4975-9e6d-240aee5d9e17 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:08.701516 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5f0b76b2-117b-4975-9e6d-240aee5d9e17 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:08.836950 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5f0b76b2-117b-4975-9e6d-240aee5d9e17 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:08.846207 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5f0b76b2-117b-4975-9e6d-240aee5d9e17 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.157569 May 26 17:02:08.846832 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 226/480] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:08 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:09.863774 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9aaf5492-d661-4d65-8865-6c13c649e1cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:09.864439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9aaf5492-d661-4d65-8865-6c13c649e1cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:09.870723 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9aaf5492-d661-4d65-8865-6c13c649e1cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:09.871195 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9aaf5492-d661-4d65-8865-6c13c649e1cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:09.872030 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9aaf5492-d661-4d65-8865-6c13c649e1cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:09.872460 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9aaf5492-d661-4d65-8865-6c13c649e1cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:10.008217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9aaf5492-d661-4d65-8865-6c13c649e1cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:10.016118 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9aaf5492-d661-4d65-8865-6c13c649e1cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.156492 May 26 17:02:10.016698 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 255/481] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:09 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:11.033953 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-08f93bcc-5186-4b31-a223-56689e135c7c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:11.034629 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-08f93bcc-5186-4b31-a223-56689e135c7c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:11.041196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-08f93bcc-5186-4b31-a223-56689e135c7c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.041648 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-08f93bcc-5186-4b31-a223-56689e135c7c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.042462 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-08f93bcc-5186-4b31-a223-56689e135c7c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.043576 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-08f93bcc-5186-4b31-a223-56689e135c7c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.206611 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-08f93bcc-5186-4b31-a223-56689e135c7c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:11.214892 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-08f93bcc-5186-4b31-a223-56689e135c7c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1505 microversion: 2.1 time: 0.184600 May 26 17:02:11.231344 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 227/482] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:11 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:11.239571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-73cb0d47-6ff6-4e96-940e-264e1930c556 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cde79acc-4eed-463f-81c0-f343d1d22e75"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:11.240690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-73cb0d47-6ff6-4e96-940e-264e1930c556 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:11.246958 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-73cb0d47-6ff6-4e96-940e-264e1930c556 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.247406 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-73cb0d47-6ff6-4e96-940e-264e1930c556 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.248186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-73cb0d47-6ff6-4e96-940e-264e1930c556 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.249443 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-73cb0d47-6ff6-4e96-940e-264e1930c556 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.274095 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-73cb0d47-6ff6-4e96-940e-264e1930c556 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] HTTP exception thrown: Cannot 'attach_volume' instance bf36dc82-736a-4235-a29d-663f9341ab63 while it is in vm_state rescued May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-73cb0d47-6ff6-4e96-940e-264e1930c556 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Request method failure captured: May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: POST /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63/os-volume_attachments HTTP/1.1 May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 74 May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7ICrWbJE07SpsbGPvKFPZcXYZJyQkTyQK4OS5UehWo0LNcTgmpOR54Ko5HnVJ6hxOPBMJ-Hz5oXWE0LemMPQsWnjPq2QVy-5mm_exw_ya8_ffr8b9Pc59qAlGdLrwBR2X4SFcLofYd8EHjWCjXO1KVOMsnHVkBFVQ6uIKvJUgf0IBo May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: d84da619d6f042ed8ccf92259d52e180 May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:02:11.275828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:02:11.277738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_d84da619d6f042ed8ccf92259d52e180"}]}] May 26 17:02:11.277738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:02:11.277738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: d84da619d6f042ed8ccf92259d52e180 May 26 17:02:11.277738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:02:11.277738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-ServerRescueNegativeTestJSON-1303393345-project May 26 17:02:11.277738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:02:11.277738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:02:11.277738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: a3ccb15b11de4cfea727f0aa453f6e2b May 26 17:02:11.277738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1303393345-project May 26 17:02:11.277738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: May 26 17:02:11.277738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {"volumeAttachment": {"volumeId": "cde79acc-4eed-463f-81c0-f343d1d22e75"}} May 26 17:02:11.277738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Cannot 'attach_volume' instance bf36dc82-736a-4235-a29d-663f9341ab63 while it is in vm_state rescued May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'server_id': 'bf36dc82-736a-4235-a29d-663f9341ab63', 'body': {'volumeAttachment': {'volumeId': 'cde79acc-4eed-463f-81c0-f343d1d22e75'}}} May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf36dc82-736a-4235-a29d-663f9341ab63 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:11.278683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bf36dc82-736a-4235-a29d-663f9341ab63 while it is in vm_state rescued May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:11.280504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:11.282356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:11.282356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:11.282356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bf36dc82-736a-4235-a29d-663f9341ab63 while it is in vm_state rescued May 26 17:02:11.282356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:02:11.282356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-73cb0d47-6ff6-4e96-940e-264e1930c556 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Returning 409 to user: Cannot 'attach_volume' instance bf36dc82-736a-4235-a29d-663f9341ab63 while it is in vm_state rescued {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:11.282356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-73cb0d47-6ff6-4e96-940e-264e1930c556 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "POST /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041909 May 26 17:02:11.282356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 256/483] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:02:11 2022] POST /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 17:02:11.287417 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b4a87552-1e73-4197-8ed8-8ee357eb6968 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:11.287951 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b4a87552-1e73-4197-8ed8-8ee357eb6968 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:11.294643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b4a87552-1e73-4197-8ed8-8ee357eb6968 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.295096 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b4a87552-1e73-4197-8ed8-8ee357eb6968 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.295869 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b4a87552-1e73-4197-8ed8-8ee357eb6968 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.296309 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b4a87552-1e73-4197-8ed8-8ee357eb6968 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.500792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b4a87552-1e73-4197-8ed8-8ee357eb6968 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "POST /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63/action" status: 202 len: 0 microversion: 2.1 time: 0.217327 May 26 17:02:11.501610 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 228/484] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:02:11 2022] POST /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:02:11.509808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ce8d1aa1-4526-4086-a36b-c33f7df198fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:11.510460 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ce8d1aa1-4526-4086-a36b-c33f7df198fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:11.517453 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ce8d1aa1-4526-4086-a36b-c33f7df198fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.517905 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ce8d1aa1-4526-4086-a36b-c33f7df198fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.518719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ce8d1aa1-4526-4086-a36b-c33f7df198fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.519372 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ce8d1aa1-4526-4086-a36b-c33f7df198fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.671111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ce8d1aa1-4526-4086-a36b-c33f7df198fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:11.678925 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ce8d1aa1-4526-4086-a36b-c33f7df198fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1513 microversion: 2.1 time: 0.172943 May 26 17:02:11.679742 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 257/485] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:11 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:12.698233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d5b4cff6-bffc-454c-bff1-60b1cc020f3a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:12.699867 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d5b4cff6-bffc-454c-bff1-60b1cc020f3a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:12.706966 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d5b4cff6-bffc-454c-bff1-60b1cc020f3a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:12.707692 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d5b4cff6-bffc-454c-bff1-60b1cc020f3a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:12.708483 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d5b4cff6-bffc-454c-bff1-60b1cc020f3a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:12.708927 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d5b4cff6-bffc-454c-bff1-60b1cc020f3a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:12.851524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d5b4cff6-bffc-454c-bff1-60b1cc020f3a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:12.861535 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d5b4cff6-bffc-454c-bff1-60b1cc020f3a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1513 microversion: 2.1 time: 0.166646 May 26 17:02:12.861535 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 229/486] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:12 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:13.877148 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a55bd482-1bac-45b9-991c-9601d7388bcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:13.877844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a55bd482-1bac-45b9-991c-9601d7388bcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:13.884075 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a55bd482-1bac-45b9-991c-9601d7388bcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:13.884520 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a55bd482-1bac-45b9-991c-9601d7388bcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:13.885292 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a55bd482-1bac-45b9-991c-9601d7388bcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:13.885725 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a55bd482-1bac-45b9-991c-9601d7388bcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:14.020872 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a55bd482-1bac-45b9-991c-9601d7388bcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:14.028889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a55bd482-1bac-45b9-991c-9601d7388bcf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1513 microversion: 2.1 time: 0.155610 May 26 17:02:14.029447 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 258/487] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:13 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:15.046024 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e38c63d1-9cd9-4e84-8fe6-37e3ed2b8865 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:15.046684 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e38c63d1-9cd9-4e84-8fe6-37e3ed2b8865 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:15.053081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e38c63d1-9cd9-4e84-8fe6-37e3ed2b8865 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:15.053519 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e38c63d1-9cd9-4e84-8fe6-37e3ed2b8865 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:15.054273 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e38c63d1-9cd9-4e84-8fe6-37e3ed2b8865 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:15.054729 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e38c63d1-9cd9-4e84-8fe6-37e3ed2b8865 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:15.185985 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e38c63d1-9cd9-4e84-8fe6-37e3ed2b8865 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:15.193436 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e38c63d1-9cd9-4e84-8fe6-37e3ed2b8865 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1513 microversion: 2.1 time: 0.152309 May 26 17:02:15.194007 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 230/488] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:15 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:15.512209 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1560713391", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:15.563060 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.network.neutron [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] validate_networks() for None {{(pid=130526) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:02:15.829084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Flavor limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:02:15.829584 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Image limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:02:15.830077 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Flavor pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:02:15.830575 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Image pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:02:15.831020 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:02:15.841233 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:15.841674 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:15.842510 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:15.842944 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:15.859375 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Getting quotas for project a70a17aef5134c73bbc7ac4da3f54639. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:02:15.863359 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Getting quotas for user 021c0021978f451183c05967e82d5059 and project a70a17aef5134c73bbc7ac4da3f54639. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:02:15.874494 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Going to run 1 instances... {{(pid=130526) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:02:15.876701 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:02:16.024858 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7c6815cf-1034-493b-af9e-7b6fa09168f1 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.516426 May 26 17:02:16.025500 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 259/489] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:02:15 2022] POST /compute/v2.1/servers => generated 382 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:02:16.036635 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b0f2acd4-4eb8-4143-bc60-ed56e7dcafd6 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:16.037236 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b0f2acd4-4eb8-4143-bc60-ed56e7dcafd6 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:16.096293 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b0f2acd4-4eb8-4143-bc60-ed56e7dcafd6 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:16.102938 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b0f2acd4-4eb8-4143-bc60-ed56e7dcafd6 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1219 microversion: 2.1 time: 0.070493 May 26 17:02:16.103570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 231/490] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:16 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:16.212421 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c5601169-e148-4264-9d9c-b3c0cb060a0a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:16.213117 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c5601169-e148-4264-9d9c-b3c0cb060a0a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:16.219940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5601169-e148-4264-9d9c-b3c0cb060a0a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:16.220406 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5601169-e148-4264-9d9c-b3c0cb060a0a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:16.221169 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5601169-e148-4264-9d9c-b3c0cb060a0a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:16.221607 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5601169-e148-4264-9d9c-b3c0cb060a0a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:16.225594 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=87 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:16.357015 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c5601169-e148-4264-9d9c-b3c0cb060a0a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:16.365267 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c5601169-e148-4264-9d9c-b3c0cb060a0a tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1513 microversion: 2.1 time: 0.156757 May 26 17:02:16.365835 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 260/491] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:16 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:17.121105 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-02b9d6fd-74a4-4c8c-b241-bd1e875c8f4e tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:17.121713 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-02b9d6fd-74a4-4c8c-b241-bd1e875c8f4e tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:17.128991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-02b9d6fd-74a4-4c8c-b241-bd1e875c8f4e tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:17.129428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-02b9d6fd-74a4-4c8c-b241-bd1e875c8f4e tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:17.130204 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-02b9d6fd-74a4-4c8c-b241-bd1e875c8f4e tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:17.130683 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-02b9d6fd-74a4-4c8c-b241-bd1e875c8f4e tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:17.189924 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-02b9d6fd-74a4-4c8c-b241-bd1e875c8f4e tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:17.197267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-02b9d6fd-74a4-4c8c-b241-bd1e875c8f4e tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1223 microversion: 2.1 time: 0.080399 May 26 17:02:17.197817 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 232/492] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:17 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:17.382970 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a2788aa4-fab0-49f8-8555-7cdd446c6b8d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:17.383530 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a2788aa4-fab0-49f8-8555-7cdd446c6b8d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:17.390398 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a2788aa4-fab0-49f8-8555-7cdd446c6b8d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:17.390852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a2788aa4-fab0-49f8-8555-7cdd446c6b8d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:17.391616 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a2788aa4-fab0-49f8-8555-7cdd446c6b8d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:17.392050 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a2788aa4-fab0-49f8-8555-7cdd446c6b8d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:17.518046 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a2788aa4-fab0-49f8-8555-7cdd446c6b8d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:17.525749 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a2788aa4-fab0-49f8-8555-7cdd446c6b8d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1513 microversion: 2.1 time: 0.146769 May 26 17:02:17.526313 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 261/493] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:17 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:18.216338 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1964b524-c6f2-4d9e-a592-9ed38b811172 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:18.217051 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1964b524-c6f2-4d9e-a592-9ed38b811172 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:18.223598 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1964b524-c6f2-4d9e-a592-9ed38b811172 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:18.223984 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1964b524-c6f2-4d9e-a592-9ed38b811172 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:18.224782 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1964b524-c6f2-4d9e-a592-9ed38b811172 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:18.225217 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1964b524-c6f2-4d9e-a592-9ed38b811172 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:18.288466 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1964b524-c6f2-4d9e-a592-9ed38b811172 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:18.296484 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1964b524-c6f2-4d9e-a592-9ed38b811172 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1271 microversion: 2.1 time: 0.085762 May 26 17:02:18.297049 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 233/494] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:18 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:18.544352 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4fe01390-e9b8-484d-9948-5f763eaaadd2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:18.544922 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4fe01390-e9b8-484d-9948-5f763eaaadd2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:18.550968 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4fe01390-e9b8-484d-9948-5f763eaaadd2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:18.551415 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4fe01390-e9b8-484d-9948-5f763eaaadd2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:18.552174 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4fe01390-e9b8-484d-9948-5f763eaaadd2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:18.552606 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4fe01390-e9b8-484d-9948-5f763eaaadd2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:18.690935 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4fe01390-e9b8-484d-9948-5f763eaaadd2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:18.698358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4fe01390-e9b8-484d-9948-5f763eaaadd2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1519 microversion: 2.1 time: 0.159085 May 26 17:02:18.699584 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 262/495] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:18 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:19.322241 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6ce497a1-4f30-45e0-bd16-e0ce1cd74d1c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:19.322868 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6ce497a1-4f30-45e0-bd16-e0ce1cd74d1c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:19.331355 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6ce497a1-4f30-45e0-bd16-e0ce1cd74d1c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:19.332056 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6ce497a1-4f30-45e0-bd16-e0ce1cd74d1c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:19.333156 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6ce497a1-4f30-45e0-bd16-e0ce1cd74d1c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:19.333745 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6ce497a1-4f30-45e0-bd16-e0ce1cd74d1c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:19.447452 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6ce497a1-4f30-45e0-bd16-e0ce1cd74d1c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:19.457791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6ce497a1-4f30-45e0-bd16-e0ce1cd74d1c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1289 microversion: 2.1 time: 0.139232 May 26 17:02:19.457791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 234/496] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:19 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1289 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:20.476499 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-df74ad4c-134f-4f2f-9347-828417b11f2a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:20.477234 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-df74ad4c-134f-4f2f-9347-828417b11f2a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:20.483912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-df74ad4c-134f-4f2f-9347-828417b11f2a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:20.484453 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-df74ad4c-134f-4f2f-9347-828417b11f2a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:20.485323 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-df74ad4c-134f-4f2f-9347-828417b11f2a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:20.485824 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-df74ad4c-134f-4f2f-9347-828417b11f2a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:20.620170 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-df74ad4c-134f-4f2f-9347-828417b11f2a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:20.628363 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-df74ad4c-134f-4f2f-9347-828417b11f2a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1319 microversion: 2.1 time: 0.156002 May 26 17:02:20.628940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 263/497] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:20 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:21.219838 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-cd5a070c-a392-48f5-a495-b8050eade411 req-5cbf512b-35e9-490e-bb35-897729197253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd24992d-b841-4139-a3e9-856efb07e513", "tag": "b89f8afd-42da-45c7-b0e8-4cf0cdd083eb"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:21.228803 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-cd5a070c-a392-48f5-a495-b8050eade411 req-5cbf512b-35e9-490e-bb35-897729197253 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:21.229243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-cd5a070c-a392-48f5-a495-b8050eade411 req-5cbf512b-35e9-490e-bb35-897729197253 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:21.242482 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-cd5a070c-a392-48f5-a495-b8050eade411 req-5cbf512b-35e9-490e-bb35-897729197253 service nova] Creating event network-changed:b89f8afd-42da-45c7-b0e8-4cf0cdd083eb for instance bd24992d-b841-4139-a3e9-856efb07e513 on hv-cinder-83607 May 26 17:02:21.249311 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-cd5a070c-a392-48f5-a495-b8050eade411 req-5cbf512b-35e9-490e-bb35-897729197253 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033144 May 26 17:02:21.249919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 235/498] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:21.403866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d9caf0f2-cfc9-41cc-bb2b-3aa3ae558dfc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Action: 'create', calling method: .version_select at 0x7fd251172670>, body: {"keypair": {"name": "tempest-keypair-399033353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt9jwnY9jobgjbZhtG5XIaIB9GJQDxqtY85gwzaTE1jmaGmQgcGY8/Suy79leGGiFMyoJAqV9/jrged14MnmQRx2oaO0IRHnV4mlLzJL6ZSvZL3MZzNdAZqehMe+AAUoQ=="}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:21.421557 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-d9caf0f2-cfc9-41cc-bb2b-3aa3ae558dfc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Getting quotas for project d84da619d6f042ed8ccf92259d52e180. Resources: {'key_pairs'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:02:21.426623 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-d9caf0f2-cfc9-41cc-bb2b-3aa3ae558dfc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Getting quotas for user a3ccb15b11de4cfea727f0aa453f6e2b and project d84da619d6f042ed8ccf92259d52e180. Resources: {'key_pairs'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:02:21.572532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d9caf0f2-cfc9-41cc-bb2b-3aa3ae558dfc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173347 May 26 17:02:21.573193 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 264/499] 10.222.0.112 () {60 vars in 1163 bytes} [Thu May 26 17:02:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:21.647173 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-92fb1ba2-a0a9-403e-ae39-d50a519f320f tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:21.647934 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-92fb1ba2-a0a9-403e-ae39-d50a519f320f tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:21.655756 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-92fb1ba2-a0a9-403e-ae39-d50a519f320f tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:21.656507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-92fb1ba2-a0a9-403e-ae39-d50a519f320f tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:21.657306 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-92fb1ba2-a0a9-403e-ae39-d50a519f320f tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:21.657753 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-92fb1ba2-a0a9-403e-ae39-d50a519f320f tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:22.016146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-92fb1ba2-a0a9-403e-ae39-d50a519f320f tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:22.023530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-92fb1ba2-a0a9-403e-ae39-d50a519f320f tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1319 microversion: 2.1 time: 0.380771 May 26 17:02:22.024112 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 236/500] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:21 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:22.179617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2e354b55-8ea1-47e7-b39b-ba7a1be60260 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:22.180028 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2e354b55-8ea1-47e7-b39b-ba7a1be60260 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:22.186714 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2e354b55-8ea1-47e7-b39b-ba7a1be60260 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:22.187163 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2e354b55-8ea1-47e7-b39b-ba7a1be60260 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:22.187940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2e354b55-8ea1-47e7-b39b-ba7a1be60260 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:22.188373 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2e354b55-8ea1-47e7-b39b-ba7a1be60260 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:22.213477 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2e354b55-8ea1-47e7-b39b-ba7a1be60260 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/ips" status: 200 len: 149 microversion: 2.1 time: 0.037847 May 26 17:02:22.213984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 265/501] 10.222.0.112 () {58 vars in 1252 bytes} [Thu May 26 17:02:22 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:23.041084 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-26fba2ba-8969-47ff-964a-599aa0944368 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:23.041705 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-26fba2ba-8969-47ff-964a-599aa0944368 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:23.048679 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=38 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:23.050402 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-26fba2ba-8969-47ff-964a-599aa0944368 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:23.050858 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-26fba2ba-8969-47ff-964a-599aa0944368 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:23.051646 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-26fba2ba-8969-47ff-964a-599aa0944368 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:23.052078 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-26fba2ba-8969-47ff-964a-599aa0944368 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:23.200076 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-26fba2ba-8969-47ff-964a-599aa0944368 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:23.210123 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-26fba2ba-8969-47ff-964a-599aa0944368 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1319 microversion: 2.1 time: 0.172588 May 26 17:02:23.212028 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 237/502] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:23 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:24.228732 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b0dd635f-6481-42a6-9935-fd117e96dcf9 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:24.229339 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b0dd635f-6481-42a6-9935-fd117e96dcf9 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:24.235580 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b0dd635f-6481-42a6-9935-fd117e96dcf9 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:24.236027 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b0dd635f-6481-42a6-9935-fd117e96dcf9 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:24.236808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b0dd635f-6481-42a6-9935-fd117e96dcf9 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:24.237227 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b0dd635f-6481-42a6-9935-fd117e96dcf9 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:24.446506 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b0dd635f-6481-42a6-9935-fd117e96dcf9 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:24.454706 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b0dd635f-6481-42a6-9935-fd117e96dcf9 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1319 microversion: 2.1 time: 0.229631 May 26 17:02:24.455294 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 266/503] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:24 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:24.633623 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1816921571", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0de04a3-e04b-481e-8f6c-fe332bf20519"}], "security_groups": [{"name": "tempest-securitygroup--1163010445"}], "key_name": "tempest-keypair-399033353", "user_data": "}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:24.741533 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] validate_networks() for [('e0de04a3-e04b-481e-8f6c-fe332bf20519', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:02:25.118442 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:02:25.118859 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:02:25.119322 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:02:25.119723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:02:25.120128 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:02:25.128953 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:25.129392 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:25.130171 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:25.130795 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:25.147376 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Getting quotas for project d84da619d6f042ed8ccf92259d52e180. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:02:25.151313 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Getting quotas for user a3ccb15b11de4cfea727f0aa453f6e2b and project d84da619d6f042ed8ccf92259d52e180. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:02:25.162661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:02:25.164931 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:02:25.195401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9b89a465-a235-407e-9e00-e6e94db40cf3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86f46ceb-ae94-4737-b499-2a352dcad793"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:25.196472 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9b89a465-a235-407e-9e00-e6e94db40cf3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:25.203014 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9b89a465-a235-407e-9e00-e6e94db40cf3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:25.203474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9b89a465-a235-407e-9e00-e6e94db40cf3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:25.204279 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9b89a465-a235-407e-9e00-e6e94db40cf3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:25.204718 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9b89a465-a235-407e-9e00-e6e94db40cf3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:25.305847 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8bd95121-81df-4776-9345-ea8d02c6d592 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 0.676434 May 26 17:02:25.306862 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 238/504] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:02:24 2022] POST /compute/v2.1/servers => generated 411 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:02:25.316576 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-decf72ef-52ba-4a88-9118-ea3a98ac9164 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:25.317342 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-decf72ef-52ba-4a88-9118-ea3a98ac9164 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:25.378222 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-decf72ef-52ba-4a88-9118-ea3a98ac9164 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:25.384526 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-decf72ef-52ba-4a88-9118-ea3a98ac9164 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1249 microversion: 2.1 time: 0.071783 May 26 17:02:25.385098 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 239/505] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:25 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1249 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:25.471818 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0ae6d5a4-af37-489b-a82a-c3aead20a086 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:25.472517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0ae6d5a4-af37-489b-a82a-c3aead20a086 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:25.479313 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0ae6d5a4-af37-489b-a82a-c3aead20a086 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:25.479886 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0ae6d5a4-af37-489b-a82a-c3aead20a086 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:25.480787 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0ae6d5a4-af37-489b-a82a-c3aead20a086 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:25.481219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0ae6d5a4-af37-489b-a82a-c3aead20a086 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:25.497558 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:25.616572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0ae6d5a4-af37-489b-a82a-c3aead20a086 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:25.624719 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0ae6d5a4-af37-489b-a82a-c3aead20a086 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1319 microversion: 2.1 time: 0.156704 May 26 17:02:25.625281 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 240/506] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:25 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:25.850375 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:26.401481 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-324f4821-9bb8-4361-970c-5b486588dec0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:26.402743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-324f4821-9bb8-4361-970c-5b486588dec0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:26.409630 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-324f4821-9bb8-4361-970c-5b486588dec0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:26.410079 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-324f4821-9bb8-4361-970c-5b486588dec0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:26.410996 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-324f4821-9bb8-4361-970c-5b486588dec0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:26.411432 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-324f4821-9bb8-4361-970c-5b486588dec0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:26.475504 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-324f4821-9bb8-4361-970c-5b486588dec0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:26.482863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-324f4821-9bb8-4361-970c-5b486588dec0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1253 microversion: 2.1 time: 0.085588 May 26 17:02:26.483437 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 241/507] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:26 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1253 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:26.642146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-265a9f25-f0aa-458b-9c4d-fb813c17158a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:26.642787 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-265a9f25-f0aa-458b-9c4d-fb813c17158a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:26.649010 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-265a9f25-f0aa-458b-9c4d-fb813c17158a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:26.649464 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-265a9f25-f0aa-458b-9c4d-fb813c17158a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:26.650240 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-265a9f25-f0aa-458b-9c4d-fb813c17158a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:26.650717 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-265a9f25-f0aa-458b-9c4d-fb813c17158a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:26.788209 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-265a9f25-f0aa-458b-9c4d-fb813c17158a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:26.795874 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-265a9f25-f0aa-458b-9c4d-fb813c17158a tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1319 microversion: 2.1 time: 0.157582 May 26 17:02:26.796508 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 242/508] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:26 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:27.499660 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-49d1ab2a-3f77-4c90-a005-d14663eb3877 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:27.503164 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-49d1ab2a-3f77-4c90-a005-d14663eb3877 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:27.506886 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-49d1ab2a-3f77-4c90-a005-d14663eb3877 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:27.507342 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-49d1ab2a-3f77-4c90-a005-d14663eb3877 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:27.508102 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-49d1ab2a-3f77-4c90-a005-d14663eb3877 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:27.508534 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-49d1ab2a-3f77-4c90-a005-d14663eb3877 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:27.569739 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-49d1ab2a-3f77-4c90-a005-d14663eb3877 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:27.577379 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-49d1ab2a-3f77-4c90-a005-d14663eb3877 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1245 microversion: 2.1 time: 0.081666 May 26 17:02:27.577995 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 243/509] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:27 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:27.813706 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3cbf75b7-b004-4819-8b62-53e1ea45ed78 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:27.814451 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3cbf75b7-b004-4819-8b62-53e1ea45ed78 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:27.820608 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3cbf75b7-b004-4819-8b62-53e1ea45ed78 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:27.821041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3cbf75b7-b004-4819-8b62-53e1ea45ed78 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:27.821789 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3cbf75b7-b004-4819-8b62-53e1ea45ed78 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:27.822211 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3cbf75b7-b004-4819-8b62-53e1ea45ed78 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:27.950962 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3cbf75b7-b004-4819-8b62-53e1ea45ed78 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:27.958553 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3cbf75b7-b004-4819-8b62-53e1ea45ed78 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1319 microversion: 2.1 time: 0.148698 May 26 17:02:27.959168 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 244/510] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:27 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:28.066409 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9b89a465-a235-407e-9e00-e6e94db40cf3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.874552 May 26 17:02:28.071627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 267/511] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:02:25 2022] POST /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/os-volume_attachments => generated 194 bytes in 2876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:28.597192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-40654a4b-8726-47b7-b4f2-3fa6ca9a1c72 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:28.599913 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-40654a4b-8726-47b7-b4f2-3fa6ca9a1c72 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:28.604451 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-40654a4b-8726-47b7-b4f2-3fa6ca9a1c72 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:28.605055 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-40654a4b-8726-47b7-b4f2-3fa6ca9a1c72 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:28.605863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-40654a4b-8726-47b7-b4f2-3fa6ca9a1c72 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:28.606352 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-40654a4b-8726-47b7-b4f2-3fa6ca9a1c72 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:28.671777 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-40654a4b-8726-47b7-b4f2-3fa6ca9a1c72 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:28.680107 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-40654a4b-8726-47b7-b4f2-3fa6ca9a1c72 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1301 microversion: 2.1 time: 0.086115 May 26 17:02:28.680107 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 245/512] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:28 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:28.976737 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4edbfeb7-7e6b-401f-921d-064b39cd3214 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:28.977422 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4edbfeb7-7e6b-401f-921d-064b39cd3214 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:28.979401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:28.984451 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4edbfeb7-7e6b-401f-921d-064b39cd3214 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:28.984883 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4edbfeb7-7e6b-401f-921d-064b39cd3214 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:28.989329 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4edbfeb7-7e6b-401f-921d-064b39cd3214 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:28.989329 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4edbfeb7-7e6b-401f-921d-064b39cd3214 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:29.123024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4edbfeb7-7e6b-401f-921d-064b39cd3214 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:29.130514 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4edbfeb7-7e6b-401f-921d-064b39cd3214 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1319 microversion: 2.1 time: 0.158284 May 26 17:02:29.131396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 268/513] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:28 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:29.697308 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b5f71d39-7665-4261-9a63-6ac8fb8fbc11 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:29.697928 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b5f71d39-7665-4261-9a63-6ac8fb8fbc11 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:29.704986 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b5f71d39-7665-4261-9a63-6ac8fb8fbc11 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:29.705512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b5f71d39-7665-4261-9a63-6ac8fb8fbc11 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:29.706267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b5f71d39-7665-4261-9a63-6ac8fb8fbc11 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:29.706729 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b5f71d39-7665-4261-9a63-6ac8fb8fbc11 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:29.792715 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b5f71d39-7665-4261-9a63-6ac8fb8fbc11 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:29.800126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b5f71d39-7665-4261-9a63-6ac8fb8fbc11 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1307 microversion: 2.1 time: 0.108090 May 26 17:02:29.800704 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 246/514] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:29 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:29.891488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-624e7064-b324-4722-89d5-4ab1e99c9b00 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:29.892127 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-624e7064-b324-4722-89d5-4ab1e99c9b00 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:29.898229 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-624e7064-b324-4722-89d5-4ab1e99c9b00 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:29.898742 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-624e7064-b324-4722-89d5-4ab1e99c9b00 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:29.899590 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-624e7064-b324-4722-89d5-4ab1e99c9b00 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:29.900021 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-624e7064-b324-4722-89d5-4ab1e99c9b00 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:29.926195 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-624e7064-b324-4722-89d5-4ab1e99c9b00 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/ips" status: 200 len: 146 microversion: 2.1 time: 0.038390 May 26 17:02:29.929639 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 269/515] 10.222.0.112 () {58 vars in 1252 bytes} [Thu May 26 17:02:29 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:30.148749 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fa1d11cb-68b6-4d88-acbd-7e38d0d36928 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:30.149542 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fa1d11cb-68b6-4d88-acbd-7e38d0d36928 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:30.156739 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa1d11cb-68b6-4d88-acbd-7e38d0d36928 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:30.161491 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa1d11cb-68b6-4d88-acbd-7e38d0d36928 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:30.161491 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa1d11cb-68b6-4d88-acbd-7e38d0d36928 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:30.161491 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa1d11cb-68b6-4d88-acbd-7e38d0d36928 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:30.250972 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-0c8f4111-14bd-4820-8b2e-a2a7c768d9ae req-e0f5e3dc-ba05-42fe-b5be-9af864a0997f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd24992d-b841-4139-a3e9-856efb07e513", "name": "network-vif-plugged", "status": "completed", "tag": "b89f8afd-42da-45c7-b0e8-4cf0cdd083eb"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:30.276105 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-0c8f4111-14bd-4820-8b2e-a2a7c768d9ae req-e0f5e3dc-ba05-42fe-b5be-9af864a0997f service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:30.276105 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-0c8f4111-14bd-4820-8b2e-a2a7c768d9ae req-e0f5e3dc-ba05-42fe-b5be-9af864a0997f service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:30.287403 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-0c8f4111-14bd-4820-8b2e-a2a7c768d9ae req-e0f5e3dc-ba05-42fe-b5be-9af864a0997f service nova] Creating event network-vif-plugged:b89f8afd-42da-45c7-b0e8-4cf0cdd083eb for instance bd24992d-b841-4139-a3e9-856efb07e513 on hv-cinder-83607 May 26 17:02:30.299433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-0c8f4111-14bd-4820-8b2e-a2a7c768d9ae req-e0f5e3dc-ba05-42fe-b5be-9af864a0997f service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053439 May 26 17:02:30.300132 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 270/516] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:02:30.337996 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fa1d11cb-68b6-4d88-acbd-7e38d0d36928 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:30.346864 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fa1d11cb-68b6-4d88-acbd-7e38d0d36928 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1319 microversion: 2.1 time: 0.201987 May 26 17:02:30.347452 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 247/517] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:30 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:30.818143 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-94427bc3-9a83-4d8f-a21c-15da5cade94c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:30.818978 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-94427bc3-9a83-4d8f-a21c-15da5cade94c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:30.826475 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-94427bc3-9a83-4d8f-a21c-15da5cade94c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:30.827367 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-94427bc3-9a83-4d8f-a21c-15da5cade94c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:30.827692 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-94427bc3-9a83-4d8f-a21c-15da5cade94c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:30.828124 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-94427bc3-9a83-4d8f-a21c-15da5cade94c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:30.962545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-94427bc3-9a83-4d8f-a21c-15da5cade94c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:30.971253 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-94427bc3-9a83-4d8f-a21c-15da5cade94c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.157905 May 26 17:02:30.971926 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 271/518] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:30 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:31.368548 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-305c83d7-df66-4d28-9ede-65f53a29fc35 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:31.371933 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-305c83d7-df66-4d28-9ede-65f53a29fc35 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:31.372294 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-d5a8b185-8b14-4d25-9c0d-8d77fbb0822c req-c8946ec9-066a-4e31-b0a3-0cad318f1df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea078281-ddf9-4637-9cfd-ca0709e2e74d", "tag": "43b6e144-5534-4897-b9ef-4e0176bc01ea"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:31.384806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-305c83d7-df66-4d28-9ede-65f53a29fc35 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:31.384806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-305c83d7-df66-4d28-9ede-65f53a29fc35 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:31.385763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-305c83d7-df66-4d28-9ede-65f53a29fc35 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:31.387171 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-305c83d7-df66-4d28-9ede-65f53a29fc35 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:31.388536 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-d5a8b185-8b14-4d25-9c0d-8d77fbb0822c req-c8946ec9-066a-4e31-b0a3-0cad318f1df1 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:31.389370 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-d5a8b185-8b14-4d25-9c0d-8d77fbb0822c req-c8946ec9-066a-4e31-b0a3-0cad318f1df1 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:31.413754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-d5a8b185-8b14-4d25-9c0d-8d77fbb0822c req-c8946ec9-066a-4e31-b0a3-0cad318f1df1 service nova] Creating event network-changed:43b6e144-5534-4897-b9ef-4e0176bc01ea for instance ea078281-ddf9-4637-9cfd-ca0709e2e74d on hv-cinder-83607 May 26 17:02:31.422067 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-d5a8b185-8b14-4d25-9c0d-8d77fbb0822c req-c8946ec9-066a-4e31-b0a3-0cad318f1df1 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060134 May 26 17:02:31.423454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 248/519] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:31.435011 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=10 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:31.548369 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-305c83d7-df66-4d28-9ede-65f53a29fc35 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:31.559237 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-305c83d7-df66-4d28-9ede-65f53a29fc35 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1319 microversion: 2.1 time: 0.197673 May 26 17:02:31.560145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 272/520] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:31 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:31.988971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-223c8d66-543e-43d4-be6f-1123a409586c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:31.989663 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-223c8d66-543e-43d4-be6f-1123a409586c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:31.996077 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-223c8d66-543e-43d4-be6f-1123a409586c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:31.996526 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-223c8d66-543e-43d4-be6f-1123a409586c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:31.997339 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-223c8d66-543e-43d4-be6f-1123a409586c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:31.997796 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-223c8d66-543e-43d4-be6f-1123a409586c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:32.130393 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-223c8d66-543e-43d4-be6f-1123a409586c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:32.138973 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-223c8d66-543e-43d4-be6f-1123a409586c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.154247 May 26 17:02:32.139497 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 249/521] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:31 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:32.577165 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e2f77f61-3a8c-46ff-bfde-1943f2b3cf05 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:32.577803 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e2f77f61-3a8c-46ff-bfde-1943f2b3cf05 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:32.584635 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e2f77f61-3a8c-46ff-bfde-1943f2b3cf05 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:32.585084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e2f77f61-3a8c-46ff-bfde-1943f2b3cf05 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:32.585847 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e2f77f61-3a8c-46ff-bfde-1943f2b3cf05 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:32.586286 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e2f77f61-3a8c-46ff-bfde-1943f2b3cf05 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:32.724836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e2f77f61-3a8c-46ff-bfde-1943f2b3cf05 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:32.732360 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e2f77f61-3a8c-46ff-bfde-1943f2b3cf05 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1319 microversion: 2.1 time: 0.159822 May 26 17:02:32.732930 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 273/522] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:32 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:33.156903 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-dfc7ccf3-938d-4922-aec1-7dbdc9d7717b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:33.157544 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-dfc7ccf3-938d-4922-aec1-7dbdc9d7717b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:33.164177 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dfc7ccf3-938d-4922-aec1-7dbdc9d7717b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:33.164616 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dfc7ccf3-938d-4922-aec1-7dbdc9d7717b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:33.165399 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dfc7ccf3-938d-4922-aec1-7dbdc9d7717b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:33.165801 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dfc7ccf3-938d-4922-aec1-7dbdc9d7717b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:33.300723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-dfc7ccf3-938d-4922-aec1-7dbdc9d7717b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:33.308254 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-dfc7ccf3-938d-4922-aec1-7dbdc9d7717b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.156222 May 26 17:02:33.322051 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 250/523] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:33 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:33.749469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bbc24811-a995-4d7b-85ff-76cb49325d6c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:33.750098 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bbc24811-a995-4d7b-85ff-76cb49325d6c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:33.756809 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bbc24811-a995-4d7b-85ff-76cb49325d6c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:33.757262 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bbc24811-a995-4d7b-85ff-76cb49325d6c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:33.758090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bbc24811-a995-4d7b-85ff-76cb49325d6c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:33.758554 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bbc24811-a995-4d7b-85ff-76cb49325d6c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:33.776871 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f9475ca8-04b5-4081-bb97-54d57033be92 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53b12efc-1991-4224-b745-76af58409c99"}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:33.778188 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f9475ca8-04b5-4081-bb97-54d57033be92 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:33.785037 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f9475ca8-04b5-4081-bb97-54d57033be92 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:33.785500 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f9475ca8-04b5-4081-bb97-54d57033be92 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:33.786341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f9475ca8-04b5-4081-bb97-54d57033be92 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:33.786802 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f9475ca8-04b5-4081-bb97-54d57033be92 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:33.905650 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bbc24811-a995-4d7b-85ff-76cb49325d6c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:33.913138 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bbc24811-a995-4d7b-85ff-76cb49325d6c tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1319 microversion: 2.1 time: 0.168048 May 26 17:02:33.913698 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 274/524] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:33 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:34.324843 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2e4896c3-c251-4b9f-b7d8-b201ecc11a38 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:34.326381 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2e4896c3-c251-4b9f-b7d8-b201ecc11a38 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:34.332627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2e4896c3-c251-4b9f-b7d8-b201ecc11a38 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:34.333074 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2e4896c3-c251-4b9f-b7d8-b201ecc11a38 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:34.333849 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2e4896c3-c251-4b9f-b7d8-b201ecc11a38 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:34.334400 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2e4896c3-c251-4b9f-b7d8-b201ecc11a38 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:34.467233 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2e4896c3-c251-4b9f-b7d8-b201ecc11a38 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:34.475010 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2e4896c3-c251-4b9f-b7d8-b201ecc11a38 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.153948 May 26 17:02:34.475710 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 275/525] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:34 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:34.929312 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d9375218-60df-4e11-8c09-ad5d31e1cab3 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:34.929965 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d9375218-60df-4e11-8c09-ad5d31e1cab3 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:34.936345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d9375218-60df-4e11-8c09-ad5d31e1cab3 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:34.936791 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d9375218-60df-4e11-8c09-ad5d31e1cab3 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:34.937555 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d9375218-60df-4e11-8c09-ad5d31e1cab3 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:34.938611 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d9375218-60df-4e11-8c09-ad5d31e1cab3 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:35.071282 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d9375218-60df-4e11-8c09-ad5d31e1cab3 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:35.079250 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d9375218-60df-4e11-8c09-ad5d31e1cab3 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1469 microversion: 2.1 time: 0.153273 May 26 17:02:35.079837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 276/526] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:34 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:35.119086 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3126d7a9-e2f3-4316-b30a-5f7af7a0ef5b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:35.119579 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3126d7a9-e2f3-4316-b30a-5f7af7a0ef5b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:35.125536 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3126d7a9-e2f3-4316-b30a-5f7af7a0ef5b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:35.125984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3126d7a9-e2f3-4316-b30a-5f7af7a0ef5b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:35.126766 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3126d7a9-e2f3-4316-b30a-5f7af7a0ef5b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:35.127200 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3126d7a9-e2f3-4316-b30a-5f7af7a0ef5b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:35.138004 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:35.151736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3126d7a9-e2f3-4316-b30a-5f7af7a0ef5b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Going to try to terminate instance {{(pid=130526) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:02:35.154748 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:35.381938 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=10 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:35.467649 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3126d7a9-e2f3-4316-b30a-5f7af7a0ef5b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "DELETE /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 204 len: 0 microversion: 2.1 time: 0.351904 May 26 17:02:35.468227 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 277/527] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:02:35 2022] DELETE /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 17:02:35.476943 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a663799b-373e-4ca9-9edb-684551e6a974 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:35.477633 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a663799b-373e-4ca9-9edb-684551e6a974 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:35.483531 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a663799b-373e-4ca9-9edb-684551e6a974 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:35.483971 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a663799b-373e-4ca9-9edb-684551e6a974 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:35.485207 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a663799b-373e-4ca9-9edb-684551e6a974 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:35.485686 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a663799b-373e-4ca9-9edb-684551e6a974 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:35.638822 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a663799b-373e-4ca9-9edb-684551e6a974 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:35.647574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a663799b-373e-4ca9-9edb-684551e6a974 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1475 microversion: 2.1 time: 0.174658 May 26 17:02:35.648145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 278/528] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:35 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1475 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:35.653250 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6e483af4-3fbb-409e-adce-a4e053aecee0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:35.653948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6e483af4-3fbb-409e-adce-a4e053aecee0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:35.660000 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6e483af4-3fbb-409e-adce-a4e053aecee0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:35.660464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6e483af4-3fbb-409e-adce-a4e053aecee0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:35.661216 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6e483af4-3fbb-409e-adce-a4e053aecee0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:35.661639 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6e483af4-3fbb-409e-adce-a4e053aecee0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:35.792757 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6e483af4-3fbb-409e-adce-a4e053aecee0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:35.800677 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6e483af4-3fbb-409e-adce-a4e053aecee0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.151536 May 26 17:02:35.801242 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 279/529] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:35 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:36.477572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f9475ca8-04b5-4081-bb97-54d57033be92 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "POST /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.704481 May 26 17:02:36.478200 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 251/530] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:02:33 2022] POST /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/os-volume_attachments => generated 194 bytes in 2706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:36.664821 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0272b134-20d5-4b35-a5ff-25808786f53b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:36.665412 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0272b134-20d5-4b35-a5ff-25808786f53b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:36.671832 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0272b134-20d5-4b35-a5ff-25808786f53b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:36.673320 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0272b134-20d5-4b35-a5ff-25808786f53b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:36.674076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0272b134-20d5-4b35-a5ff-25808786f53b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:36.674544 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0272b134-20d5-4b35-a5ff-25808786f53b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:36.804134 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0272b134-20d5-4b35-a5ff-25808786f53b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:36.811699 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0272b134-20d5-4b35-a5ff-25808786f53b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1475 microversion: 2.1 time: 0.150702 May 26 17:02:36.812314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 280/531] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:36 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1475 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:36.819222 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e6d4b787-8da3-4b74-928a-0474593a33f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:36.819928 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e6d4b787-8da3-4b74-928a-0474593a33f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:36.826092 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6d4b787-8da3-4b74-928a-0474593a33f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:36.826574 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6d4b787-8da3-4b74-928a-0474593a33f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:36.827332 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6d4b787-8da3-4b74-928a-0474593a33f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:36.827764 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6d4b787-8da3-4b74-928a-0474593a33f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:36.966588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e6d4b787-8da3-4b74-928a-0474593a33f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:36.974832 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e6d4b787-8da3-4b74-928a-0474593a33f3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.161055 May 26 17:02:36.977943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 252/532] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:36 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:37.829843 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-30afe405-13a8-428c-bced-107ef234ac4b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:37.830433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-30afe405-13a8-428c-bced-107ef234ac4b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:37.837086 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30afe405-13a8-428c-bced-107ef234ac4b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:37.837528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30afe405-13a8-428c-bced-107ef234ac4b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:37.838290 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30afe405-13a8-428c-bced-107ef234ac4b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:37.838744 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30afe405-13a8-428c-bced-107ef234ac4b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:37.966464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-30afe405-13a8-428c-bced-107ef234ac4b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:37.973891 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-30afe405-13a8-428c-bced-107ef234ac4b tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1475 microversion: 2.1 time: 0.148649 May 26 17:02:37.974472 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 281/533] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:37 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1475 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:37.992070 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-42dbb190-0e9c-4780-a912-f64cc4813348 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:37.992981 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-42dbb190-0e9c-4780-a912-f64cc4813348 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:37.999582 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-42dbb190-0e9c-4780-a912-f64cc4813348 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:38.000586 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-42dbb190-0e9c-4780-a912-f64cc4813348 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:38.001832 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-42dbb190-0e9c-4780-a912-f64cc4813348 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:38.002313 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-42dbb190-0e9c-4780-a912-f64cc4813348 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:38.154751 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-42dbb190-0e9c-4780-a912-f64cc4813348 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:38.162895 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-42dbb190-0e9c-4780-a912-f64cc4813348 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.175125 May 26 17:02:38.163490 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 253/534] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:37 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:38.991408 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-eb5ad6dd-e525-4557-9753-ecd298f5b979 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:38.992040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-eb5ad6dd-e525-4557-9753-ecd298f5b979 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:38.998539 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eb5ad6dd-e525-4557-9753-ecd298f5b979 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:38.998982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eb5ad6dd-e525-4557-9753-ecd298f5b979 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:38.999731 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eb5ad6dd-e525-4557-9753-ecd298f5b979 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:39.000758 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eb5ad6dd-e525-4557-9753-ecd298f5b979 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:39.134150 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-eb5ad6dd-e525-4557-9753-ecd298f5b979 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:39.141806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-eb5ad6dd-e525-4557-9753-ecd298f5b979 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1475 microversion: 2.1 time: 0.154264 May 26 17:02:39.142514 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 282/535] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:38 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1475 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:39.179501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-99ff0b01-713b-40d3-9581-26cd4d5af30f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:39.180199 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-99ff0b01-713b-40d3-9581-26cd4d5af30f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:39.187991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-99ff0b01-713b-40d3-9581-26cd4d5af30f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:39.188566 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-99ff0b01-713b-40d3-9581-26cd4d5af30f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:39.189529 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-99ff0b01-713b-40d3-9581-26cd4d5af30f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:39.190090 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-99ff0b01-713b-40d3-9581-26cd4d5af30f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:39.335978 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-99ff0b01-713b-40d3-9581-26cd4d5af30f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:39.343410 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-99ff0b01-713b-40d3-9581-26cd4d5af30f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.167725 May 26 17:02:39.344684 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 254/536] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:39 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:39.756091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f0213f5e-be6e-4132-946d-910be19c1552 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:39.756592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f0213f5e-be6e-4132-946d-910be19c1552 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:39.762566 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f0213f5e-be6e-4132-946d-910be19c1552 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:39.763016 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f0213f5e-be6e-4132-946d-910be19c1552 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:39.763784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f0213f5e-be6e-4132-946d-910be19c1552 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:39.764215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f0213f5e-be6e-4132-946d-910be19c1552 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:39.788075 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f0213f5e-be6e-4132-946d-910be19c1552 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/ips" status: 200 len: 151 microversion: 2.20 time: 0.035777 May 26 17:02:39.788649 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 283/537] 10.222.0.112 () {60 vars in 1293 bytes} [Thu May 26 17:02:39 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:02:40.158793 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-171064bf-f3ff-4599-a156-8d02d2a75250 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:40.159410 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-171064bf-f3ff-4599-a156-8d02d2a75250 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:40.165564 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-171064bf-f3ff-4599-a156-8d02d2a75250 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:40.166003 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-171064bf-f3ff-4599-a156-8d02d2a75250 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:40.166827 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-171064bf-f3ff-4599-a156-8d02d2a75250 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:40.167274 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-171064bf-f3ff-4599-a156-8d02d2a75250 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:40.361047 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-766b0a96-bf1f-4404-9bfd-13aba481e3bb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:40.361791 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-766b0a96-bf1f-4404-9bfd-13aba481e3bb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:40.368929 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-766b0a96-bf1f-4404-9bfd-13aba481e3bb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:40.375821 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-766b0a96-bf1f-4404-9bfd-13aba481e3bb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:40.375821 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-766b0a96-bf1f-4404-9bfd-13aba481e3bb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:40.375821 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-766b0a96-bf1f-4404-9bfd-13aba481e3bb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:40.529279 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-766b0a96-bf1f-4404-9bfd-13aba481e3bb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:40.538780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-766b0a96-bf1f-4404-9bfd-13aba481e3bb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.182104 May 26 17:02:40.539333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 284/538] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:40 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:40.622778 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-171064bf-f3ff-4599-a156-8d02d2a75250 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:40.646647 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-171064bf-f3ff-4599-a156-8d02d2a75250 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1475 microversion: 2.1 time: 0.489377 May 26 17:02:40.646647 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 255/539] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:40 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1475 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:40.926168 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ded22779-bfc5-4435-9ccf-08affea8e728 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: .version_select at 0x7fd250fde550>, body: {"keypair": {"name": "tempest-keypair-1805569523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnLx0bALkfu1SpEB52hYK/7N4i4WyhP9bJAf+eSeoPsWXDhgqpXLifEL8ms0RKtBIr63nOJ/AnwdfV8P+A/NJiIqBG9XYYO6izG17PbKJ9/TJbm4SxfnktYQsyjpgxrUQ=="}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:40.939991 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-ded22779-bfc5-4435-9ccf-08affea8e728 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'key_pairs'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:02:40.943720 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-ded22779-bfc5-4435-9ccf-08affea8e728 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for user 289cb250e20344d28bd5fd17255d5896 and project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'key_pairs'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:02:41.091943 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ded22779-bfc5-4435-9ccf-08affea8e728 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.170027 May 26 17:02:41.095245 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 285/540] 10.222.0.112 () {60 vars in 1163 bytes} [Thu May 26 17:02:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:41.106833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-64cf9ac7-96aa-490f-86d3-396247c688ca req-7fee0729-8954-4a1f-af50-90a9d7fef68f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd24992d-b841-4139-a3e9-856efb07e513", "name": "network-vif-deleted", "tag": "b89f8afd-42da-45c7-b0e8-4cf0cdd083eb"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:41.115714 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-64cf9ac7-96aa-490f-86d3-396247c688ca req-7fee0729-8954-4a1f-af50-90a9d7fef68f service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:41.116160 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-64cf9ac7-96aa-490f-86d3-396247c688ca req-7fee0729-8954-4a1f-af50-90a9d7fef68f service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:41.128245 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-64cf9ac7-96aa-490f-86d3-396247c688ca req-7fee0729-8954-4a1f-af50-90a9d7fef68f service nova] Creating event network-vif-deleted:b89f8afd-42da-45c7-b0e8-4cf0cdd083eb for instance bd24992d-b841-4139-a3e9-856efb07e513 on hv-cinder-83607 May 26 17:02:41.133346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-64cf9ac7-96aa-490f-86d3-396247c688ca req-7fee0729-8954-4a1f-af50-90a9d7fef68f service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030174 May 26 17:02:41.135438 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 256/541] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:41.557734 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dc0b9394-ae1e-4baa-b103-7aa561ec2379 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:41.558398 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-dc0b9394-ae1e-4baa-b103-7aa561ec2379 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:41.565426 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dc0b9394-ae1e-4baa-b103-7aa561ec2379 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:41.565873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dc0b9394-ae1e-4baa-b103-7aa561ec2379 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:41.566660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dc0b9394-ae1e-4baa-b103-7aa561ec2379 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:41.567090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dc0b9394-ae1e-4baa-b103-7aa561ec2379 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:41.662242 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f1c46484-c445-4770-9452-4bde9f2c7277 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:41.663936 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f1c46484-c445-4770-9452-4bde9f2c7277 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:41.670972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f1c46484-c445-4770-9452-4bde9f2c7277 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:41.671352 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f1c46484-c445-4770-9452-4bde9f2c7277 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:41.672284 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f1c46484-c445-4770-9452-4bde9f2c7277 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:41.672921 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f1c46484-c445-4770-9452-4bde9f2c7277 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:41.677126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:41.741882 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dc0b9394-ae1e-4baa-b103-7aa561ec2379 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:41.746609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f1c46484-c445-4770-9452-4bde9f2c7277 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:41.749452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-dc0b9394-ae1e-4baa-b103-7aa561ec2379 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.196080 May 26 17:02:41.750607 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 286/542] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:41 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:41.754741 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f1c46484-c445-4770-9452-4bde9f2c7277 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1433 microversion: 2.1 time: 0.097143 May 26 17:02:41.755311 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 257/543] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:41 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1433 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:42.766121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-798940cb-2eeb-4ebb-986e-7dadb7869db9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:42.767029 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-798940cb-2eeb-4ebb-986e-7dadb7869db9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:42.771808 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-95233cd1-f677-4b98-9caa-8547550c93a2 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:42.772424 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-95233cd1-f677-4b98-9caa-8547550c93a2 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:42.773998 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-798940cb-2eeb-4ebb-986e-7dadb7869db9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:42.774488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-798940cb-2eeb-4ebb-986e-7dadb7869db9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:42.775264 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-798940cb-2eeb-4ebb-986e-7dadb7869db9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:42.775702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-798940cb-2eeb-4ebb-986e-7dadb7869db9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:42.780688 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-95233cd1-f677-4b98-9caa-8547550c93a2 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:42.781248 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-95233cd1-f677-4b98-9caa-8547550c93a2 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:42.782054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-95233cd1-f677-4b98-9caa-8547550c93a2 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:42.782694 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-95233cd1-f677-4b98-9caa-8547550c93a2 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:42.851174 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-95233cd1-f677-4b98-9caa-8547550c93a2 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:42.858655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-95233cd1-f677-4b98-9caa-8547550c93a2 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1433 microversion: 2.1 time: 0.090671 May 26 17:02:42.860100 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 258/544] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:42 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1433 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:43.002741 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-798940cb-2eeb-4ebb-986e-7dadb7869db9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:43.010129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-798940cb-2eeb-4ebb-986e-7dadb7869db9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.247992 May 26 17:02:43.010726 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 287/545] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:42 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:43.380160 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f365bf07-80b0-47b7-bf8b-8de0eaeaeebe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:43.380717 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f365bf07-80b0-47b7-bf8b-8de0eaeaeebe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:43.387015 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f365bf07-80b0-47b7-bf8b-8de0eaeaeebe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:43.387456 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f365bf07-80b0-47b7-bf8b-8de0eaeaeebe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:43.388213 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f365bf07-80b0-47b7-bf8b-8de0eaeaeebe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:43.388641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f365bf07-80b0-47b7-bf8b-8de0eaeaeebe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:43.411209 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-f365bf07-80b0-47b7-bf8b-8de0eaeaeebe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lazy-loading 'flavor' on Instance uuid 79e5f6d0-3136-4741-a4c4-916b792ee1c8 {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:02:43.663868 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-380284898", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "685d481c-e3f1-425b-9a28-548fe43d099c"}], "security_groups": [{"name": "tempest-securitygroup--987690614"}], "key_name": "tempest-keypair-1805569523", "user_data": "}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:43.785305 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.network.neutron [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] validate_networks() for [('685d481c-e3f1-425b-9a28-548fe43d099c', None, None, None, None, None)] {{(pid=130526) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:02:44.098702 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f365bf07-80b0-47b7-bf8b-8de0eaeaeebe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "POST /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/action" status: 202 len: 0 microversion: 2.20 time: 0.723456 May 26 17:02:44.102706 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 259/546] 10.222.0.112 () {62 vars in 1323 bytes} [Thu May 26 17:02:43 2022] POST /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/action => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 17:02:44.104709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-837d2e1a-bc0b-46cc-bd84-eef52e542561 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:44.105406 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-837d2e1a-bc0b-46cc-bd84-eef52e542561 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:44.112956 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-837d2e1a-bc0b-46cc-bd84-eef52e542561 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:44.113403 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-837d2e1a-bc0b-46cc-bd84-eef52e542561 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:44.114171 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-837d2e1a-bc0b-46cc-bd84-eef52e542561 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:44.114630 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-837d2e1a-bc0b-46cc-bd84-eef52e542561 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:44.180773 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-837d2e1a-bc0b-46cc-bd84-eef52e542561 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:44.189504 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-837d2e1a-bc0b-46cc-bd84-eef52e542561 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1433 microversion: 2.1 time: 0.088855 May 26 17:02:44.190080 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 260/547] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:44 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1433 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:44.194676 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0f40c52b-c387-4f21-acac-2fd2a49757d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:44.195283 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0f40c52b-c387-4f21-acac-2fd2a49757d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:44.201065 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0f40c52b-c387-4f21-acac-2fd2a49757d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:44.201518 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0f40c52b-c387-4f21-acac-2fd2a49757d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:44.202282 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0f40c52b-c387-4f21-acac-2fd2a49757d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:44.202749 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0f40c52b-c387-4f21-acac-2fd2a49757d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:44.334186 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0f40c52b-c387-4f21-acac-2fd2a49757d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:44.341508 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0f40c52b-c387-4f21-acac-2fd2a49757d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.150413 May 26 17:02:44.342069 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 261/548] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:44 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:44.351561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-796c34ee-8eae-4068-ba66-83863d0c86e6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:44.351561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-796c34ee-8eae-4068-ba66-83863d0c86e6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:44.353557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-796c34ee-8eae-4068-ba66-83863d0c86e6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:44.353948 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-796c34ee-8eae-4068-ba66-83863d0c86e6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:44.354744 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-796c34ee-8eae-4068-ba66-83863d0c86e6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:44.355187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-796c34ee-8eae-4068-ba66-83863d0c86e6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:44.360608 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Flavor limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:02:44.361113 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Image limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:02:44.361716 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Flavor pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:02:44.362130 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Image pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:02:44.363756 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:02:44.371418 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:44.372056 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:44.372849 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:44.373279 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:44.390460 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:02:44.394508 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for user 289cb250e20344d28bd5fd17255d5896 and project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:02:44.405853 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Going to run 1 instances... {{(pid=130526) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:02:44.408702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:02:44.491139 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-796c34ee-8eae-4068-ba66-83863d0c86e6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:44.499183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-796c34ee-8eae-4068-ba66-83863d0c86e6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:44.501476 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-796c34ee-8eae-4068-ba66-83863d0c86e6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:44.502698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-796c34ee-8eae-4068-ba66-83863d0c86e6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.159671 May 26 17:02:44.503257 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 262/549] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:44 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:02:44.612005 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f307c9d2-273a-4b4d-9509-8044e3e5e1fe tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.952256 May 26 17:02:44.612748 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 288/550] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:02:43 2022] POST /compute/v2.1/servers => generated 403 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 17:02:44.622445 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-68bf4b71-30d9-495a-bcc9-acad2f60613e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:44.623107 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-68bf4b71-30d9-495a-bcc9-acad2f60613e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:44.678022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-68bf4b71-30d9-495a-bcc9-acad2f60613e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:44.685175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-68bf4b71-30d9-495a-bcc9-acad2f60613e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1245 microversion: 2.1 time: 0.066528 May 26 17:02:44.692759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 263/551] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:44 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1245 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:45.208737 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2ab6ebeb-1b72-4c42-a22c-c70cbb75f2be tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:45.209278 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2ab6ebeb-1b72-4c42-a22c-c70cbb75f2be tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:45.218399 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2ab6ebeb-1b72-4c42-a22c-c70cbb75f2be tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:45.219491 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2ab6ebeb-1b72-4c42-a22c-c70cbb75f2be tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:45.220442 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2ab6ebeb-1b72-4c42-a22c-c70cbb75f2be tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:45.220698 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2ab6ebeb-1b72-4c42-a22c-c70cbb75f2be tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:45.288176 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2ab6ebeb-1b72-4c42-a22c-c70cbb75f2be tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:45.296048 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2ab6ebeb-1b72-4c42-a22c-c70cbb75f2be tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1304 microversion: 2.1 time: 0.092100 May 26 17:02:45.296425 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 289/552] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:45 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:45.358607 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-eb3f2ba2-e118-462c-8dd8-9de8fb0d9062 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:45.359217 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-eb3f2ba2-e118-462c-8dd8-9de8fb0d9062 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:45.366592 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb3f2ba2-e118-462c-8dd8-9de8fb0d9062 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:45.367047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb3f2ba2-e118-462c-8dd8-9de8fb0d9062 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:45.367819 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb3f2ba2-e118-462c-8dd8-9de8fb0d9062 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:45.368254 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb3f2ba2-e118-462c-8dd8-9de8fb0d9062 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:45.505557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-eb3f2ba2-e118-462c-8dd8-9de8fb0d9062 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:45.513222 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-eb3f2ba2-e118-462c-8dd8-9de8fb0d9062 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.158657 May 26 17:02:45.513797 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 264/553] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:45 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:45.522880 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d1877dc2-2469-4cc5-938c-c0bac3e55b60 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:45.525570 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d1877dc2-2469-4cc5-938c-c0bac3e55b60 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:45.529754 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d1877dc2-2469-4cc5-938c-c0bac3e55b60 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:45.530205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d1877dc2-2469-4cc5-938c-c0bac3e55b60 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:45.531799 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d1877dc2-2469-4cc5-938c-c0bac3e55b60 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:45.532150 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d1877dc2-2469-4cc5-938c-c0bac3e55b60 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:45.671372 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d1877dc2-2469-4cc5-938c-c0bac3e55b60 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:45.680639 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d1877dc2-2469-4cc5-938c-c0bac3e55b60 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:45.682132 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d1877dc2-2469-4cc5-938c-c0bac3e55b60 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:45.683314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d1877dc2-2469-4cc5-938c-c0bac3e55b60 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.164579 May 26 17:02:45.683881 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 290/554] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:45 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:02:45.702620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d58a43f4-9905-46e8-935a-0349ac65ac96 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:45.703768 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d58a43f4-9905-46e8-935a-0349ac65ac96 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:45.709920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d58a43f4-9905-46e8-935a-0349ac65ac96 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:45.710398 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d58a43f4-9905-46e8-935a-0349ac65ac96 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:45.711155 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d58a43f4-9905-46e8-935a-0349ac65ac96 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:45.711588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d58a43f4-9905-46e8-935a-0349ac65ac96 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:46.002992 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d58a43f4-9905-46e8-935a-0349ac65ac96 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:46.010492 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d58a43f4-9905-46e8-935a-0349ac65ac96 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1249 microversion: 2.1 time: 0.311634 May 26 17:02:46.011224 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 265/555] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:45 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1249 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:46.313241 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-53984afe-e7d2-41c5-8054-03364ae57b00 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:46.313969 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-53984afe-e7d2-41c5-8054-03364ae57b00 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:46.320521 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-53984afe-e7d2-41c5-8054-03364ae57b00 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:46.320971 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-53984afe-e7d2-41c5-8054-03364ae57b00 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:46.321741 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-53984afe-e7d2-41c5-8054-03364ae57b00 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:46.322175 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-53984afe-e7d2-41c5-8054-03364ae57b00 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:46.353477 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-53984afe-e7d2-41c5-8054-03364ae57b00 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:46.353973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-53984afe-e7d2-41c5-8054-03364ae57b00 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:46.354457 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-53984afe-e7d2-41c5-8054-03364ae57b00 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lazy-loading 'fault' on Instance uuid bd24992d-b841-4139-a3e9-856efb07e513 {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:02:46.396660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-53984afe-e7d2-41c5-8054-03364ae57b00 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c0021978f451183c05967e82d5059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a17aef5134c73bbc7ac4da3f54639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:46.404208 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-53984afe-e7d2-41c5-8054-03364ae57b00 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 200 len: 1309 microversion: 2.1 time: 0.095874 May 26 17:02:46.404780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 291/556] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:46 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:46.531779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-93fab666-0497-4ab9-b0b5-5737079428a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:46.532496 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-93fab666-0497-4ab9-b0b5-5737079428a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:46.539265 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-93fab666-0497-4ab9-b0b5-5737079428a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:46.539713 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-93fab666-0497-4ab9-b0b5-5737079428a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:46.540484 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-93fab666-0497-4ab9-b0b5-5737079428a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:46.540921 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-93fab666-0497-4ab9-b0b5-5737079428a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:46.673250 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-93fab666-0497-4ab9-b0b5-5737079428a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:46.680877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-93fab666-0497-4ab9-b0b5-5737079428a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.153744 May 26 17:02:46.681765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 266/557] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:46 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:46.702868 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0c6d2f82-c605-4d56-8d21-ed6848d90d3d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:46.704440 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0c6d2f82-c605-4d56-8d21-ed6848d90d3d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:46.710678 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0c6d2f82-c605-4d56-8d21-ed6848d90d3d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:46.711121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0c6d2f82-c605-4d56-8d21-ed6848d90d3d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:46.711870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0c6d2f82-c605-4d56-8d21-ed6848d90d3d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:46.712319 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0c6d2f82-c605-4d56-8d21-ed6848d90d3d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:46.842859 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0c6d2f82-c605-4d56-8d21-ed6848d90d3d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:46.851941 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0c6d2f82-c605-4d56-8d21-ed6848d90d3d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:46.853453 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0c6d2f82-c605-4d56-8d21-ed6848d90d3d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:46.854640 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0c6d2f82-c605-4d56-8d21-ed6848d90d3d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.155680 May 26 17:02:46.855195 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 292/558] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:46 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:02:47.028097 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5038197c-5dfe-49ba-8684-fbc3639e47fa tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:47.028702 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5038197c-5dfe-49ba-8684-fbc3639e47fa tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:47.036149 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5038197c-5dfe-49ba-8684-fbc3639e47fa tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:47.036597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5038197c-5dfe-49ba-8684-fbc3639e47fa tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:47.037374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5038197c-5dfe-49ba-8684-fbc3639e47fa tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:47.037803 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5038197c-5dfe-49ba-8684-fbc3639e47fa tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:47.105973 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5038197c-5dfe-49ba-8684-fbc3639e47fa tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:47.114417 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5038197c-5dfe-49ba-8684-fbc3639e47fa tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1297 microversion: 2.1 time: 0.090057 May 26 17:02:47.114993 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 267/559] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:47 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:47.421006 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-67b8fb66-749c-43de-bdf8-d20b8533bd61 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:47.422075 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-67b8fb66-749c-43de-bdf8-d20b8533bd61 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] [instance: bd24992d-b841-4139-a3e9-856efb07e513] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:47.428690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-67b8fb66-749c-43de-bdf8-d20b8533bd61 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:47.429137 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-67b8fb66-749c-43de-bdf8-d20b8533bd61 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:47.429896 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-67b8fb66-749c-43de-bdf8-d20b8533bd61 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:47.430346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-67b8fb66-749c-43de-bdf8-d20b8533bd61 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:47.444663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-67b8fb66-749c-43de-bdf8-d20b8533bd61 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] HTTP exception thrown: Instance bd24992d-b841-4139-a3e9-856efb07e513 could not be found. May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-67b8fb66-749c-43de-bdf8-d20b8533bd61 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Request method failure captured: May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 HTTP/1.1 May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7KUKSWd7-30efFCb3Wwet-OGpJQQBGXeKFyOHVcHFd_H2H9s4bVJ0VMasvqw4vjfDCp6F0tsV8IYGccYReOnGV7UsJ8xhNd0lYemgGHNpM1fcK_KQUQg1NMKAYWPTVwLDyWMrbcRsUY297YPWZ5nISSmMYCH2epvF1ZhXGU_0Bb_-A May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: a70a17aef5134c73bbc7ac4da3f54639 May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-VolumesNegativeTest-579581585 May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:02:47.446215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:02:47.447939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/a70a17aef5134c73bbc7ac4da3f54639"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/a70a17aef5134c73bbc7ac4da3f54639"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/a70a17aef5134c73bbc7ac4da3f54639"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_a70a17aef5134c73bbc7ac4da3f54639"}]}] May 26 17:02:47.447939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-VolumesNegativeTest-579581585 May 26 17:02:47.447939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: a70a17aef5134c73bbc7ac4da3f54639 May 26 17:02:47.447939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-VolumesNegativeTest-579581585 May 26 17:02:47.447939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-VolumesNegativeTest-579581585-project May 26 17:02:47.447939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:02:47.447939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:02:47.447939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 021c0021978f451183c05967e82d5059 May 26 17:02:47.447939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-VolumesNegativeTest-579581585-project May 26 17:02:47.447939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:02:47.447939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance bd24992d-b841-4139-a3e9-856efb07e513 could not be found. May 26 17:02:47.447939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'bd24992d-b841-4139-a3e9-856efb07e513'} May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd24992d-b841-4139-a3e9-856efb07e513 could not be found. May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:47.448857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd24992d-b841-4139-a3e9-856efb07e513 could not be found. May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd24992d-b841-4139-a3e9-856efb07e513 could not be found. May 26 17:02:47.450345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:02:47.451648 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-67b8fb66-749c-43de-bdf8-d20b8533bd61 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] Returning 404 to user: Instance bd24992d-b841-4139-a3e9-856efb07e513 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:47.451648 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-67b8fb66-749c-43de-bdf8-d20b8533bd61 tempest-VolumesNegativeTest-579581585 tempest-VolumesNegativeTest-579581585-project] 10.222.0.112 "GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513" status: 404 len: 111 microversion: 2.1 time: 0.030470 May 26 17:02:47.451648 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 293/560] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:47 2022] GET /compute/v2.1/servers/bd24992d-b841-4139-a3e9-856efb07e513 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:02:47.698872 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-767fc73b-20d7-4af5-b756-1852e9abb370 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:47.699532 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-767fc73b-20d7-4af5-b756-1852e9abb370 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:47.706799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-767fc73b-20d7-4af5-b756-1852e9abb370 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:47.707499 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-767fc73b-20d7-4af5-b756-1852e9abb370 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:47.708272 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-767fc73b-20d7-4af5-b756-1852e9abb370 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:47.708706 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-767fc73b-20d7-4af5-b756-1852e9abb370 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:47.874771 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-775ec383-5554-4a5a-9ba4-e77b5a0734b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:47.875650 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-775ec383-5554-4a5a-9ba4-e77b5a0734b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:47.889025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-775ec383-5554-4a5a-9ba4-e77b5a0734b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:47.889025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-775ec383-5554-4a5a-9ba4-e77b5a0734b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:47.889025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-775ec383-5554-4a5a-9ba4-e77b5a0734b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:47.889025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-775ec383-5554-4a5a-9ba4-e77b5a0734b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:47.958691 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-767fc73b-20d7-4af5-b756-1852e9abb370 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:47.967157 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-767fc73b-20d7-4af5-b756-1852e9abb370 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.272365 May 26 17:02:47.969127 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 268/561] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:47 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:48.037393 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-775ec383-5554-4a5a-9ba4-e77b5a0734b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:48.045407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-775ec383-5554-4a5a-9ba4-e77b5a0734b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:48.047737 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-775ec383-5554-4a5a-9ba4-e77b5a0734b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:48.048914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-775ec383-5554-4a5a-9ba4-e77b5a0734b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.178024 May 26 17:02:48.049465 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 294/562] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:47 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:02:48.132643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4a791bab-15ad-4991-a92c-8844f936e340 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:48.133874 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4a791bab-15ad-4991-a92c-8844f936e340 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:48.147017 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a791bab-15ad-4991-a92c-8844f936e340 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:48.147572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a791bab-15ad-4991-a92c-8844f936e340 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:48.149416 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a791bab-15ad-4991-a92c-8844f936e340 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:48.150054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a791bab-15ad-4991-a92c-8844f936e340 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:48.230932 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4a791bab-15ad-4991-a92c-8844f936e340 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:48.238711 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4a791bab-15ad-4991-a92c-8844f936e340 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1303 microversion: 2.1 time: 0.109751 May 26 17:02:48.239870 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 269/563] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:48 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:48.986851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2bf20675-6693-4f18-8649-ce9c2d2ef2c5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:48.987464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2bf20675-6693-4f18-8649-ce9c2d2ef2c5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:48.994130 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2bf20675-6693-4f18-8649-ce9c2d2ef2c5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:48.994628 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2bf20675-6693-4f18-8649-ce9c2d2ef2c5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:48.995631 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2bf20675-6693-4f18-8649-ce9c2d2ef2c5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:48.996072 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2bf20675-6693-4f18-8649-ce9c2d2ef2c5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:49.001018 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:49.066876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-54195a7a-4d04-4e5d-9810-c95721048434 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:49.068088 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-54195a7a-4d04-4e5d-9810-c95721048434 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:49.075130 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-54195a7a-4d04-4e5d-9810-c95721048434 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:49.075993 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-54195a7a-4d04-4e5d-9810-c95721048434 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:49.076772 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-54195a7a-4d04-4e5d-9810-c95721048434 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:49.077373 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-54195a7a-4d04-4e5d-9810-c95721048434 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:49.150687 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2bf20675-6693-4f18-8649-ce9c2d2ef2c5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:49.159289 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2bf20675-6693-4f18-8649-ce9c2d2ef2c5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.176990 May 26 17:02:49.166062 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 295/564] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:48 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:49.174960 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-cd5fe4d8-d593-4c0c-8ea7-eae873a92b39 req-d4e97373-9f83-4656-9717-052a2668ff90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea078281-ddf9-4637-9cfd-ca0709e2e74d", "name": "network-vif-plugged", "status": "completed", "tag": "43b6e144-5534-4897-b9ef-4e0176bc01ea"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:49.183523 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-cd5fe4d8-d593-4c0c-8ea7-eae873a92b39 req-d4e97373-9f83-4656-9717-052a2668ff90 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:49.184046 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-cd5fe4d8-d593-4c0c-8ea7-eae873a92b39 req-d4e97373-9f83-4656-9717-052a2668ff90 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:49.204076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-cd5fe4d8-d593-4c0c-8ea7-eae873a92b39 req-d4e97373-9f83-4656-9717-052a2668ff90 service nova] Creating event network-vif-plugged:43b6e144-5534-4897-b9ef-4e0176bc01ea for instance ea078281-ddf9-4637-9cfd-ca0709e2e74d on hv-cinder-83607 May 26 17:02:49.210132 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-cd5fe4d8-d593-4c0c-8ea7-eae873a92b39 req-d4e97373-9f83-4656-9717-052a2668ff90 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039665 May 26 17:02:49.212647 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 296/565] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:49.257274 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a8ca8a68-adb4-411c-aba6-f396ab3378b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:49.258064 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a8ca8a68-adb4-411c-aba6-f396ab3378b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:49.276219 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a8ca8a68-adb4-411c-aba6-f396ab3378b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:49.276955 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a8ca8a68-adb4-411c-aba6-f396ab3378b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:49.278151 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a8ca8a68-adb4-411c-aba6-f396ab3378b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:49.278852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a8ca8a68-adb4-411c-aba6-f396ab3378b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:49.324862 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-54195a7a-4d04-4e5d-9810-c95721048434 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:49.334090 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-54195a7a-4d04-4e5d-9810-c95721048434 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:49.451397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-54195a7a-4d04-4e5d-9810-c95721048434 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:49.451397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-54195a7a-4d04-4e5d-9810-c95721048434 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.273849 May 26 17:02:49.451397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 270/566] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:49 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:02:49.451978 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a8ca8a68-adb4-411c-aba6-f396ab3378b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:49.451978 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a8ca8a68-adb4-411c-aba6-f396ab3378b5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.177952 May 26 17:02:49.451978 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 297/567] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:49 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:49.818876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-65fba5bd-b749-4450-b473-3237a1fc5f6b req-08faa32f-b9dc-49e2-8e51-e3b81b394325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1248649c-ce32-42fd-8764-3a985faf06b8", "tag": "55e9f2ec-9d77-41f0-9a91-f494d6cec330"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:49.828724 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-65fba5bd-b749-4450-b473-3237a1fc5f6b req-08faa32f-b9dc-49e2-8e51-e3b81b394325 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:49.829449 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-65fba5bd-b749-4450-b473-3237a1fc5f6b req-08faa32f-b9dc-49e2-8e51-e3b81b394325 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:49.841284 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-65fba5bd-b749-4450-b473-3237a1fc5f6b req-08faa32f-b9dc-49e2-8e51-e3b81b394325 service nova] Creating event network-changed:55e9f2ec-9d77-41f0-9a91-f494d6cec330 for instance 1248649c-ce32-42fd-8764-3a985faf06b8 on hv-cinder-83607 May 26 17:02:49.846853 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-65fba5bd-b749-4450-b473-3237a1fc5f6b req-08faa32f-b9dc-49e2-8e51-e3b81b394325 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031920 May 26 17:02:49.847759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 271/568] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:50.176478 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-df6be7da-132f-4ab3-ae5d-daaac9a85846 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:50.182578 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-df6be7da-132f-4ab3-ae5d-daaac9a85846 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:50.184363 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-df6be7da-132f-4ab3-ae5d-daaac9a85846 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:50.184808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-df6be7da-132f-4ab3-ae5d-daaac9a85846 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:50.185568 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-df6be7da-132f-4ab3-ae5d-daaac9a85846 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:50.186006 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-df6be7da-132f-4ab3-ae5d-daaac9a85846 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:50.326822 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-df6be7da-132f-4ab3-ae5d-daaac9a85846 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:50.339876 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-df6be7da-132f-4ab3-ae5d-daaac9a85846 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.163470 May 26 17:02:50.339876 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 298/569] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:50 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:50.462349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1cc99424-cb71-430e-926e-f5c31ca41514 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:50.463125 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1cc99424-cb71-430e-926e-f5c31ca41514 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:50.463263 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fa4a7f14-0b1a-4cd2-8a8c-e5fcac0e0d63 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:50.463948 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fa4a7f14-0b1a-4cd2-8a8c-e5fcac0e0d63 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:50.470208 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1cc99424-cb71-430e-926e-f5c31ca41514 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:50.470967 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1cc99424-cb71-430e-926e-f5c31ca41514 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:50.471145 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa4a7f14-0b1a-4cd2-8a8c-e5fcac0e0d63 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:50.471598 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa4a7f14-0b1a-4cd2-8a8c-e5fcac0e0d63 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:50.471905 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1cc99424-cb71-430e-926e-f5c31ca41514 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:50.472331 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1cc99424-cb71-430e-926e-f5c31ca41514 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:50.472418 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa4a7f14-0b1a-4cd2-8a8c-e5fcac0e0d63 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:50.472796 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa4a7f14-0b1a-4cd2-8a8c-e5fcac0e0d63 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:50.609944 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1cc99424-cb71-430e-926e-f5c31ca41514 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:50.610167 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fa4a7f14-0b1a-4cd2-8a8c-e5fcac0e0d63 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:50.618240 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1cc99424-cb71-430e-926e-f5c31ca41514 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:50.619204 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fa4a7f14-0b1a-4cd2-8a8c-e5fcac0e0d63 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.161839 May 26 17:02:50.619778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1cc99424-cb71-430e-926e-f5c31ca41514 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:50.620101 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 272/570] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:50 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:50.626490 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1cc99424-cb71-430e-926e-f5c31ca41514 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.168101 May 26 17:02:50.627051 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 299/571] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:50 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:02:51.352787 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fa6a964d-b7a5-43de-ab8a-19bbbd72823b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:51.353386 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fa6a964d-b7a5-43de-ab8a-19bbbd72823b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:51.359524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa6a964d-b7a5-43de-ab8a-19bbbd72823b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:51.359972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa6a964d-b7a5-43de-ab8a-19bbbd72823b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:51.360738 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa6a964d-b7a5-43de-ab8a-19bbbd72823b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:51.361166 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa6a964d-b7a5-43de-ab8a-19bbbd72823b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:51.382209 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:51.500020 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fa6a964d-b7a5-43de-ab8a-19bbbd72823b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:51.508157 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fa6a964d-b7a5-43de-ab8a-19bbbd72823b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.159135 May 26 17:02:51.508733 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 273/572] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:51 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:51.637423 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-12ff5737-46ef-4697-8202-bbca04907e88 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:51.637928 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-12ff5737-46ef-4697-8202-bbca04907e88 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:51.645641 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12ff5737-46ef-4697-8202-bbca04907e88 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:51.646090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12ff5737-46ef-4697-8202-bbca04907e88 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:51.646985 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12ff5737-46ef-4697-8202-bbca04907e88 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:51.647379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12ff5737-46ef-4697-8202-bbca04907e88 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:51.648625 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ccae619b-b5b1-4f1a-9db3-9b5ec76b51e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:51.649322 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ccae619b-b5b1-4f1a-9db3-9b5ec76b51e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:51.657554 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ccae619b-b5b1-4f1a-9db3-9b5ec76b51e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:51.658028 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ccae619b-b5b1-4f1a-9db3-9b5ec76b51e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:51.658843 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ccae619b-b5b1-4f1a-9db3-9b5ec76b51e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:51.659384 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ccae619b-b5b1-4f1a-9db3-9b5ec76b51e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:51.809977 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ccae619b-b5b1-4f1a-9db3-9b5ec76b51e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:51.814270 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-12ff5737-46ef-4697-8202-bbca04907e88 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:51.818904 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ccae619b-b5b1-4f1a-9db3-9b5ec76b51e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:51.820397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ccae619b-b5b1-4f1a-9db3-9b5ec76b51e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:51.821550 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ccae619b-b5b1-4f1a-9db3-9b5ec76b51e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.177903 May 26 17:02:51.821894 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-12ff5737-46ef-4697-8202-bbca04907e88 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.188930 May 26 17:02:51.822107 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 274/573] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:51 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:02:51.822923 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 300/574] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:51 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:52.525928 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-83c9adac-91d8-4e05-a3fb-8d1a72f9a920 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:52.526431 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-83c9adac-91d8-4e05-a3fb-8d1a72f9a920 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:52.533548 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-83c9adac-91d8-4e05-a3fb-8d1a72f9a920 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:52.534008 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-83c9adac-91d8-4e05-a3fb-8d1a72f9a920 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:52.534817 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-83c9adac-91d8-4e05-a3fb-8d1a72f9a920 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:52.535251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-83c9adac-91d8-4e05-a3fb-8d1a72f9a920 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:52.840974 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7de19623-25d9-4938-b1f9-2c5a8df76643 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:52.841582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7de19623-25d9-4938-b1f9-2c5a8df76643 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:52.844034 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:52.849158 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7de19623-25d9-4938-b1f9-2c5a8df76643 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:52.849607 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7de19623-25d9-4938-b1f9-2c5a8df76643 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:52.850403 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7de19623-25d9-4938-b1f9-2c5a8df76643 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:52.850881 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7de19623-25d9-4938-b1f9-2c5a8df76643 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:52.874092 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-83c9adac-91d8-4e05-a3fb-8d1a72f9a920 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:52.878764 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-83c9adac-91d8-4e05-a3fb-8d1a72f9a920 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.357715 May 26 17:02:52.879696 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 275/575] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:52 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:52.883830 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cad5388d-fb07-493d-bfc9-edbfe36fab42 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:52.884506 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cad5388d-fb07-493d-bfc9-edbfe36fab42 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:52.890636 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cad5388d-fb07-493d-bfc9-edbfe36fab42 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:52.891229 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cad5388d-fb07-493d-bfc9-edbfe36fab42 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:52.892571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cad5388d-fb07-493d-bfc9-edbfe36fab42 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:52.893236 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cad5388d-fb07-493d-bfc9-edbfe36fab42 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:52.990249 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7de19623-25d9-4938-b1f9-2c5a8df76643 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:53.006614 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7de19623-25d9-4938-b1f9-2c5a8df76643 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:53.008117 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7de19623-25d9-4938-b1f9-2c5a8df76643 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:53.009429 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7de19623-25d9-4938-b1f9-2c5a8df76643 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.172335 May 26 17:02:53.010178 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 301/576] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:52 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:02:53.041040 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cad5388d-fb07-493d-bfc9-edbfe36fab42 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:53.049600 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cad5388d-fb07-493d-bfc9-edbfe36fab42 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.169267 May 26 17:02:53.050171 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 276/577] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:52 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:53.896584 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dbf23cdc-bc1c-4c1f-85a3-37d84dad49d3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:53.897188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-dbf23cdc-bc1c-4c1f-85a3-37d84dad49d3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:53.904939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dbf23cdc-bc1c-4c1f-85a3-37d84dad49d3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:53.905388 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dbf23cdc-bc1c-4c1f-85a3-37d84dad49d3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:53.906851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dbf23cdc-bc1c-4c1f-85a3-37d84dad49d3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:53.907997 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dbf23cdc-bc1c-4c1f-85a3-37d84dad49d3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:54.028960 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e69e04b1-b57b-4bcf-b8e7-6d6e09cd763e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:54.029657 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e69e04b1-b57b-4bcf-b8e7-6d6e09cd763e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:54.034105 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:54.037779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e69e04b1-b57b-4bcf-b8e7-6d6e09cd763e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:54.038226 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e69e04b1-b57b-4bcf-b8e7-6d6e09cd763e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:54.039034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e69e04b1-b57b-4bcf-b8e7-6d6e09cd763e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:54.039462 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e69e04b1-b57b-4bcf-b8e7-6d6e09cd763e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:54.050777 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dbf23cdc-bc1c-4c1f-85a3-37d84dad49d3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:54.061395 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-dbf23cdc-bc1c-4c1f-85a3-37d84dad49d3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1375 microversion: 2.1 time: 0.168474 May 26 17:02:54.061985 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 302/578] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:53 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:54.066844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-373a36ff-3f97-485d-af2c-5ae140f0dd37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:54.067823 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-373a36ff-3f97-485d-af2c-5ae140f0dd37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:54.075049 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-373a36ff-3f97-485d-af2c-5ae140f0dd37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:54.075256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-373a36ff-3f97-485d-af2c-5ae140f0dd37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:54.076010 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-373a36ff-3f97-485d-af2c-5ae140f0dd37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:54.076461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-373a36ff-3f97-485d-af2c-5ae140f0dd37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:54.259808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-373a36ff-3f97-485d-af2c-5ae140f0dd37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:54.267904 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-373a36ff-3f97-485d-af2c-5ae140f0dd37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.204626 May 26 17:02:54.268493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 303/579] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:54 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:54.271550 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e69e04b1-b57b-4bcf-b8e7-6d6e09cd763e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:54.281839 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e69e04b1-b57b-4bcf-b8e7-6d6e09cd763e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:54.284617 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e69e04b1-b57b-4bcf-b8e7-6d6e09cd763e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:54.285791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e69e04b1-b57b-4bcf-b8e7-6d6e09cd763e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.260781 May 26 17:02:54.286578 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 277/580] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:54 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:02:55.079327 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5b005dce-51e6-4ae2-84bc-19c95cca0165 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:55.080048 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5b005dce-51e6-4ae2-84bc-19c95cca0165 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:55.081844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:55.082878 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=10 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:55.088438 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b005dce-51e6-4ae2-84bc-19c95cca0165 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:55.088892 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b005dce-51e6-4ae2-84bc-19c95cca0165 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:55.089869 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b005dce-51e6-4ae2-84bc-19c95cca0165 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:55.090678 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b005dce-51e6-4ae2-84bc-19c95cca0165 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:55.230727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5b005dce-51e6-4ae2-84bc-19c95cca0165 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:55.246382 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5b005dce-51e6-4ae2-84bc-19c95cca0165 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1569 microversion: 2.1 time: 0.171003 May 26 17:02:55.247095 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 304/581] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:55 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:55.263988 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f8392e69-97d1-46b0-af8d-8d020d3acf16 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:55.264553 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f8392e69-97d1-46b0-af8d-8d020d3acf16 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:55.267124 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:55.273022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f8392e69-97d1-46b0-af8d-8d020d3acf16 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:55.273558 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f8392e69-97d1-46b0-af8d-8d020d3acf16 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:55.274610 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f8392e69-97d1-46b0-af8d-8d020d3acf16 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:55.275117 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f8392e69-97d1-46b0-af8d-8d020d3acf16 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:55.286134 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e9fa72ca-11b8-47c5-a638-9e5274060082 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:55.286920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e9fa72ca-11b8-47c5-a638-9e5274060082 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:55.294179 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e9fa72ca-11b8-47c5-a638-9e5274060082 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:55.296348 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e9fa72ca-11b8-47c5-a638-9e5274060082 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:55.297183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e9fa72ca-11b8-47c5-a638-9e5274060082 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:55.297655 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e9fa72ca-11b8-47c5-a638-9e5274060082 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:55.432569 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f8392e69-97d1-46b0-af8d-8d020d3acf16 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172376 May 26 17:02:55.433234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 278/582] 10.222.0.112 () {58 vars in 1279 bytes} [Thu May 26 17:02:55 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:55.439861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8757deaa-dc18-400b-a271-19e6164502d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:55.440908 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8757deaa-dc18-400b-a271-19e6164502d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:55.449316 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8757deaa-dc18-400b-a271-19e6164502d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:55.450305 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8757deaa-dc18-400b-a271-19e6164502d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:55.451245 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8757deaa-dc18-400b-a271-19e6164502d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:55.451984 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8757deaa-dc18-400b-a271-19e6164502d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:55.508645 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e9fa72ca-11b8-47c5-a638-9e5274060082 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:55.520912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e9fa72ca-11b8-47c5-a638-9e5274060082 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.239588 May 26 17:02:55.521840 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 305/583] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:55 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:55.701870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bb8b2ba3-e948-4049-87fe-7db98a70e328 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:55.708461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bb8b2ba3-e948-4049-87fe-7db98a70e328 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:55.711942 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bb8b2ba3-e948-4049-87fe-7db98a70e328 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:55.769573 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bb8b2ba3-e948-4049-87fe-7db98a70e328 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Going to try to stop instance {{(pid=130526) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 17:02:55.815279 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8757deaa-dc18-400b-a271-19e6164502d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:55.829934 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8757deaa-dc18-400b-a271-19e6164502d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:55.829934 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8757deaa-dc18-400b-a271-19e6164502d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:55.829934 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8757deaa-dc18-400b-a271-19e6164502d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.392451 May 26 17:02:55.830365 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 279/584] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:55 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:02:56.225055 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bb8b2ba3-e948-4049-87fe-7db98a70e328 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "POST /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/action" status: 202 len: 0 microversion: 2.1 time: 0.526851 May 26 17:02:56.227133 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 306/585] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:02:55 2022] POST /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:02:56.233950 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-aa4fa243-a0b1-448c-86f0-aaaa86bf018a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:56.234592 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-aa4fa243-a0b1-448c-86f0-aaaa86bf018a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:56.240847 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aa4fa243-a0b1-448c-86f0-aaaa86bf018a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.241301 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aa4fa243-a0b1-448c-86f0-aaaa86bf018a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.242076 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aa4fa243-a0b1-448c-86f0-aaaa86bf018a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.242542 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aa4fa243-a0b1-448c-86f0-aaaa86bf018a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.447768 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-aa4fa243-a0b1-448c-86f0-aaaa86bf018a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:56.457307 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-aa4fa243-a0b1-448c-86f0-aaaa86bf018a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.226906 May 26 17:02:56.457894 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 280/586] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:56 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:56.784502 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b38e5cec-29f7-48a7-95d2-5a6d4bcda0ee tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:56.785590 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b38e5cec-29f7-48a7-95d2-5a6d4bcda0ee tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:56.793823 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b38e5cec-29f7-48a7-95d2-5a6d4bcda0ee tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.794451 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b38e5cec-29f7-48a7-95d2-5a6d4bcda0ee tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.795496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b38e5cec-29f7-48a7-95d2-5a6d4bcda0ee tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.796087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b38e5cec-29f7-48a7-95d2-5a6d4bcda0ee tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.848837 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-845ad9c8-0452-4551-9ce9-597164acb780 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:56.849599 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-845ad9c8-0452-4551-9ce9-597164acb780 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:56.857346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-845ad9c8-0452-4551-9ce9-597164acb780 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.858027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-845ad9c8-0452-4551-9ce9-597164acb780 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.859093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-845ad9c8-0452-4551-9ce9-597164acb780 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.859652 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-845ad9c8-0452-4551-9ce9-597164acb780 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:57.073087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b38e5cec-29f7-48a7-95d2-5a6d4bcda0ee tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:57.073216 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:02:57.073216 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Thu May 26 17:02:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 (ip 10.222.0.112) !!! May 26 17:02:57.076044 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b38e5cec-29f7-48a7-95d2-5a6d4bcda0ee tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.540989 May 26 17:02:57.077064 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 307/587] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:56 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:57.116065 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-845ad9c8-0452-4551-9ce9-597164acb780 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:57.122764 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-e1962ad5-71ed-439c-add2-c87be7304418 req-5be1a3e3-0c66-4dcc-843a-bb75e0fe9022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea078281-ddf9-4637-9cfd-ca0709e2e74d", "tag": "43b6e144-5534-4897-b9ef-4e0176bc01ea"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:57.124360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-845ad9c8-0452-4551-9ce9-597164acb780 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:57.126500 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-845ad9c8-0452-4551-9ce9-597164acb780 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:57.127975 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-845ad9c8-0452-4551-9ce9-597164acb780 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.284853 May 26 17:02:57.130409 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 281/588] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:56 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:02:57.134968 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-e1962ad5-71ed-439c-add2-c87be7304418 req-5be1a3e3-0c66-4dcc-843a-bb75e0fe9022 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:57.135602 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-e1962ad5-71ed-439c-add2-c87be7304418 req-5be1a3e3-0c66-4dcc-843a-bb75e0fe9022 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:57.149203 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-e1962ad5-71ed-439c-add2-c87be7304418 req-5be1a3e3-0c66-4dcc-843a-bb75e0fe9022 service nova] Creating event network-changed:43b6e144-5534-4897-b9ef-4e0176bc01ea for instance ea078281-ddf9-4637-9cfd-ca0709e2e74d on hv-cinder-83607 May 26 17:02:57.155098 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-e1962ad5-71ed-439c-add2-c87be7304418 req-5be1a3e3-0c66-4dcc-843a-bb75e0fe9022 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036948 May 26 17:02:57.155865 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 308/589] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:57.475590 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1b8e6b38-5184-4c40-a7e4-0957c9749e54 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:57.476199 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1b8e6b38-5184-4c40-a7e4-0957c9749e54 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:57.482869 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1b8e6b38-5184-4c40-a7e4-0957c9749e54 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:57.483315 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1b8e6b38-5184-4c40-a7e4-0957c9749e54 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:57.484079 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1b8e6b38-5184-4c40-a7e4-0957c9749e54 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:57.484511 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1b8e6b38-5184-4c40-a7e4-0957c9749e54 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:57.620728 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1b8e6b38-5184-4c40-a7e4-0957c9749e54 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:57.629216 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1b8e6b38-5184-4c40-a7e4-0957c9749e54 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.157295 May 26 17:02:57.629807 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 282/590] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:57 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:58.104260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-674f98cd-ecc8-4168-98d5-8e6fa5bb1aa5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:58.104889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-674f98cd-ecc8-4168-98d5-8e6fa5bb1aa5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:58.111690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-674f98cd-ecc8-4168-98d5-8e6fa5bb1aa5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:58.112142 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-674f98cd-ecc8-4168-98d5-8e6fa5bb1aa5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:58.112920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-674f98cd-ecc8-4168-98d5-8e6fa5bb1aa5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:58.113358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-674f98cd-ecc8-4168-98d5-8e6fa5bb1aa5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:58.146361 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e6484c2f-db68-4939-bb27-c91dadf29565 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:58.147367 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e6484c2f-db68-4939-bb27-c91dadf29565 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:58.153915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6484c2f-db68-4939-bb27-c91dadf29565 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:58.154612 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6484c2f-db68-4939-bb27-c91dadf29565 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:58.155603 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6484c2f-db68-4939-bb27-c91dadf29565 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:58.156132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6484c2f-db68-4939-bb27-c91dadf29565 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:58.253035 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-674f98cd-ecc8-4168-98d5-8e6fa5bb1aa5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:58.260723 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-674f98cd-ecc8-4168-98d5-8e6fa5bb1aa5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.169428 May 26 17:02:58.261402 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 309/591] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:58 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:58.292858 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e6484c2f-db68-4939-bb27-c91dadf29565 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:58.301473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e6484c2f-db68-4939-bb27-c91dadf29565 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:58.302991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e6484c2f-db68-4939-bb27-c91dadf29565 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:58.304129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e6484c2f-db68-4939-bb27-c91dadf29565 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.161691 May 26 17:02:58.304775 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 283/592] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:58 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:02:58.647138 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f05b95b5-11ca-4dff-875a-271c5225879d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:58.647979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f05b95b5-11ca-4dff-875a-271c5225879d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:58.654891 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f05b95b5-11ca-4dff-875a-271c5225879d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:58.655391 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f05b95b5-11ca-4dff-875a-271c5225879d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:58.656160 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f05b95b5-11ca-4dff-875a-271c5225879d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:58.656598 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f05b95b5-11ca-4dff-875a-271c5225879d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:58.789030 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f05b95b5-11ca-4dff-875a-271c5225879d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:58.797018 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f05b95b5-11ca-4dff-875a-271c5225879d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.153896 May 26 17:02:58.797623 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 310/593] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:58 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:59.278794 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4a55429b-ef4c-4882-8df4-0455d0da29d9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:59.279328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4a55429b-ef4c-4882-8df4-0455d0da29d9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:59.286373 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a55429b-ef4c-4882-8df4-0455d0da29d9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:59.286822 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a55429b-ef4c-4882-8df4-0455d0da29d9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:59.287580 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a55429b-ef4c-4882-8df4-0455d0da29d9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:59.288028 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a55429b-ef4c-4882-8df4-0455d0da29d9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:59.323836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0f482da9-f070-417b-be89-e64ab28ea033 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:59.324464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0f482da9-f070-417b-be89-e64ab28ea033 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:59.331845 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0f482da9-f070-417b-be89-e64ab28ea033 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:59.332577 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0f482da9-f070-417b-be89-e64ab28ea033 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:59.333367 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0f482da9-f070-417b-be89-e64ab28ea033 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:59.333795 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0f482da9-f070-417b-be89-e64ab28ea033 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:59.419508 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4a55429b-ef4c-4882-8df4-0455d0da29d9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:59.428101 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4a55429b-ef4c-4882-8df4-0455d0da29d9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.153138 May 26 17:02:59.428672 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 284/594] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:59 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:59.467655 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0f482da9-f070-417b-be89-e64ab28ea033 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:59.476267 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0f482da9-f070-417b-be89-e64ab28ea033 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:59.477745 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0f482da9-f070-417b-be89-e64ab28ea033 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:59.478959 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0f482da9-f070-417b-be89-e64ab28ea033 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.158973 May 26 17:02:59.479508 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 311/595] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:02:59 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:02:59.815472 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-48da39c2-de48-4bc4-8649-e804efd7b103 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:59.816081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-48da39c2-de48-4bc4-8649-e804efd7b103 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:59.822119 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-48da39c2-de48-4bc4-8649-e804efd7b103 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:59.822620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-48da39c2-de48-4bc4-8649-e804efd7b103 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:59.823371 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-48da39c2-de48-4bc4-8649-e804efd7b103 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:59.823799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-48da39c2-de48-4bc4-8649-e804efd7b103 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:59.957973 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-48da39c2-de48-4bc4-8649-e804efd7b103 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:59.965812 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-48da39c2-de48-4bc4-8649-e804efd7b103 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.155372 May 26 17:02:59.966401 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 285/596] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:02:59 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:00.446485 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-220c8200-8b14-45bb-8283-c4cfca73ba60 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:00.447088 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-220c8200-8b14-45bb-8283-c4cfca73ba60 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:00.453570 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-220c8200-8b14-45bb-8283-c4cfca73ba60 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.453940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-220c8200-8b14-45bb-8283-c4cfca73ba60 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.455478 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-220c8200-8b14-45bb-8283-c4cfca73ba60 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.455925 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-220c8200-8b14-45bb-8283-c4cfca73ba60 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.458792 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:00.501977 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a1ebc231-c455-48e5-ba6f-ffe8b1234880 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:00.502806 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a1ebc231-c455-48e5-ba6f-ffe8b1234880 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:00.511137 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a1ebc231-c455-48e5-ba6f-ffe8b1234880 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.511589 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a1ebc231-c455-48e5-ba6f-ffe8b1234880 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.512419 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a1ebc231-c455-48e5-ba6f-ffe8b1234880 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.512959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a1ebc231-c455-48e5-ba6f-ffe8b1234880 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.593859 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-220c8200-8b14-45bb-8283-c4cfca73ba60 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:00.601733 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-220c8200-8b14-45bb-8283-c4cfca73ba60 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.159055 May 26 17:03:00.602306 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 312/597] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:00 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:00.645428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a1ebc231-c455-48e5-ba6f-ffe8b1234880 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:00.653788 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a1ebc231-c455-48e5-ba6f-ffe8b1234880 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:00.655305 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a1ebc231-c455-48e5-ba6f-ffe8b1234880 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:00.656461 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a1ebc231-c455-48e5-ba6f-ffe8b1234880 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.158624 May 26 17:03:00.657023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 286/598] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:00 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:03:00.983595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6a5efd64-0a95-469f-bac3-575935a1c7b0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:00.984233 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6a5efd64-0a95-469f-bac3-575935a1c7b0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:00.991171 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6a5efd64-0a95-469f-bac3-575935a1c7b0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.991615 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6a5efd64-0a95-469f-bac3-575935a1c7b0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.992362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6a5efd64-0a95-469f-bac3-575935a1c7b0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.992791 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6a5efd64-0a95-469f-bac3-575935a1c7b0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:01.123464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6a5efd64-0a95-469f-bac3-575935a1c7b0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:01.131693 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6a5efd64-0a95-469f-bac3-575935a1c7b0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.152374 May 26 17:03:01.132513 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 313/599] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:00 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:01.619181 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6c1c01ca-5c7a-4b94-872c-8d906d523469 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:01.619795 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6c1c01ca-5c7a-4b94-872c-8d906d523469 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:01.626840 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6c1c01ca-5c7a-4b94-872c-8d906d523469 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:01.627269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6c1c01ca-5c7a-4b94-872c-8d906d523469 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:01.628043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6c1c01ca-5c7a-4b94-872c-8d906d523469 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:01.628475 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6c1c01ca-5c7a-4b94-872c-8d906d523469 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:01.675326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6b93f06b-48dc-459a-a3bf-c12231e25e03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:01.676024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6b93f06b-48dc-459a-a3bf-c12231e25e03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:01.682516 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6b93f06b-48dc-459a-a3bf-c12231e25e03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:01.683021 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6b93f06b-48dc-459a-a3bf-c12231e25e03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:01.684111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6b93f06b-48dc-459a-a3bf-c12231e25e03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:01.684211 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6b93f06b-48dc-459a-a3bf-c12231e25e03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:01.761814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6c1c01ca-5c7a-4b94-872c-8d906d523469 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:01.770106 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6c1c01ca-5c7a-4b94-872c-8d906d523469 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.154712 May 26 17:03:01.770713 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 287/600] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:01 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:01.818582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6b93f06b-48dc-459a-a3bf-c12231e25e03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:01.823483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6b93f06b-48dc-459a-a3bf-c12231e25e03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:01.824974 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6b93f06b-48dc-459a-a3bf-c12231e25e03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:01.826125 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6b93f06b-48dc-459a-a3bf-c12231e25e03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.155232 May 26 17:03:01.826708 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 314/601] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:01 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:03:02.250773 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-603f0fc3-0103-4e55-827a-737867661daf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:02.251413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-603f0fc3-0103-4e55-827a-737867661daf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:02.257396 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-603f0fc3-0103-4e55-827a-737867661daf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:02.258670 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-603f0fc3-0103-4e55-827a-737867661daf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:02.258804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-603f0fc3-0103-4e55-827a-737867661daf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:02.259172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-603f0fc3-0103-4e55-827a-737867661daf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:02.396569 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-603f0fc3-0103-4e55-827a-737867661daf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:02.404419 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-603f0fc3-0103-4e55-827a-737867661daf tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.259507 May 26 17:03:02.404972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 288/602] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:02 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:02.787808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1da972de-6f10-438f-a248-e287d96d343e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:02.788447 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1da972de-6f10-438f-a248-e287d96d343e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:02.795129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1da972de-6f10-438f-a248-e287d96d343e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:02.795574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1da972de-6f10-438f-a248-e287d96d343e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:02.797695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1da972de-6f10-438f-a248-e287d96d343e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:02.797695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1da972de-6f10-438f-a248-e287d96d343e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:02.846366 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9ef863d1-c852-4969-b239-b35e9ae6a9ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:02.847009 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9ef863d1-c852-4969-b239-b35e9ae6a9ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:02.853500 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9ef863d1-c852-4969-b239-b35e9ae6a9ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:02.853953 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9ef863d1-c852-4969-b239-b35e9ae6a9ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:02.854749 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9ef863d1-c852-4969-b239-b35e9ae6a9ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:02.855185 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9ef863d1-c852-4969-b239-b35e9ae6a9ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:02.936223 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1da972de-6f10-438f-a248-e287d96d343e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:02.944633 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1da972de-6f10-438f-a248-e287d96d343e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.160555 May 26 17:03:02.955412 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 315/603] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:02 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:02.995971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9ef863d1-c852-4969-b239-b35e9ae6a9ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:03.005023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9ef863d1-c852-4969-b239-b35e9ae6a9ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:03.006567 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9ef863d1-c852-4969-b239-b35e9ae6a9ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:03.007718 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9ef863d1-c852-4969-b239-b35e9ae6a9ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.166594 May 26 17:03:03.008324 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 289/604] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:02 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:03.422569 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-209236aa-4ca9-43fa-829c-83a7a5199b16 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:03.423178 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-209236aa-4ca9-43fa-829c-83a7a5199b16 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:03.429288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-209236aa-4ca9-43fa-829c-83a7a5199b16 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:03.429743 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-209236aa-4ca9-43fa-829c-83a7a5199b16 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:03.430569 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-209236aa-4ca9-43fa-829c-83a7a5199b16 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:03.431018 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-209236aa-4ca9-43fa-829c-83a7a5199b16 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:03.564362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-209236aa-4ca9-43fa-829c-83a7a5199b16 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:03.572440 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-209236aa-4ca9-43fa-829c-83a7a5199b16 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.153700 May 26 17:03:03.573242 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 316/605] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:03 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:03.961984 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9d7182bb-099e-4a02-b738-5318b913296c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:03.962628 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9d7182bb-099e-4a02-b738-5318b913296c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:03.969054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9d7182bb-099e-4a02-b738-5318b913296c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:03.969503 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9d7182bb-099e-4a02-b738-5318b913296c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:03.970910 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9d7182bb-099e-4a02-b738-5318b913296c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:03.971348 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9d7182bb-099e-4a02-b738-5318b913296c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:03.986695 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:04.026110 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7d8526f6-64cb-4ec3-a095-c9d14308548c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:04.026759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7d8526f6-64cb-4ec3-a095-c9d14308548c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:04.034469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7d8526f6-64cb-4ec3-a095-c9d14308548c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:04.034924 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7d8526f6-64cb-4ec3-a095-c9d14308548c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:04.035806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7d8526f6-64cb-4ec3-a095-c9d14308548c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:04.036239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7d8526f6-64cb-4ec3-a095-c9d14308548c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:04.106428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9d7182bb-099e-4a02-b738-5318b913296c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:04.114904 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9d7182bb-099e-4a02-b738-5318b913296c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.156664 May 26 17:03:04.115422 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 290/606] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:03 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:04.177099 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7d8526f6-64cb-4ec3-a095-c9d14308548c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:04.185037 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7d8526f6-64cb-4ec3-a095-c9d14308548c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:04.186661 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7d8526f6-64cb-4ec3-a095-c9d14308548c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:04.187898 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7d8526f6-64cb-4ec3-a095-c9d14308548c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.165667 May 26 17:03:04.188537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 317/607] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:04 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:03:04.590807 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e9781b84-8fd9-4e58-b927-59aa064f34d9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:04.591406 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e9781b84-8fd9-4e58-b927-59aa064f34d9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:04.598947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9781b84-8fd9-4e58-b927-59aa064f34d9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:04.599517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9781b84-8fd9-4e58-b927-59aa064f34d9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:04.600376 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9781b84-8fd9-4e58-b927-59aa064f34d9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:04.600869 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9781b84-8fd9-4e58-b927-59aa064f34d9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:04.732025 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e9781b84-8fd9-4e58-b927-59aa064f34d9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:04.740050 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e9781b84-8fd9-4e58-b927-59aa064f34d9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.153511 May 26 17:03:04.740611 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 291/608] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:04 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:03:05.132917 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-fa4078da-d115-4008-a90a-9e7a55e2dd5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:05.133516 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-fa4078da-d115-4008-a90a-9e7a55e2dd5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:05.139909 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fa4078da-d115-4008-a90a-9e7a55e2dd5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:05.140356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fa4078da-d115-4008-a90a-9e7a55e2dd5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:05.141101 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fa4078da-d115-4008-a90a-9e7a55e2dd5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:05.141524 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fa4078da-d115-4008-a90a-9e7a55e2dd5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:05.274658 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fa4078da-d115-4008-a90a-9e7a55e2dd5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:05.282008 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-fa4078da-d115-4008-a90a-9e7a55e2dd5b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.153123 May 26 17:03:05.283299 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 318/609] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:05 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:05.309555 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-73bd26c9-6195-40e2-a88b-c543d334d015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:05.310159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-73bd26c9-6195-40e2-a88b-c543d334d015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:05.317003 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-73bd26c9-6195-40e2-a88b-c543d334d015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:05.317451 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-73bd26c9-6195-40e2-a88b-c543d334d015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:05.318212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-73bd26c9-6195-40e2-a88b-c543d334d015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:05.318678 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-73bd26c9-6195-40e2-a88b-c543d334d015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:05.450625 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-73bd26c9-6195-40e2-a88b-c543d334d015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:05.459364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-73bd26c9-6195-40e2-a88b-c543d334d015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:05.461242 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-73bd26c9-6195-40e2-a88b-c543d334d015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:05.462022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-73bd26c9-6195-40e2-a88b-c543d334d015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.259661 May 26 17:03:05.462614 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 292/610] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:05 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:05.757532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-65a57606-a3ed-4495-b38b-f993b38587a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:05.758142 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-65a57606-a3ed-4495-b38b-f993b38587a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:05.764276 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-65a57606-a3ed-4495-b38b-f993b38587a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:05.764742 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-65a57606-a3ed-4495-b38b-f993b38587a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:05.765492 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-65a57606-a3ed-4495-b38b-f993b38587a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:05.767780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-65a57606-a3ed-4495-b38b-f993b38587a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:05.894720 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-65a57606-a3ed-4495-b38b-f993b38587a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:05.902620 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-65a57606-a3ed-4495-b38b-f993b38587a9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.148928 May 26 17:03:05.903182 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 319/611] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:05 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:03:06.299871 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-92b426cd-462b-47a0-8462-2c49213a1147 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:06.300498 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-92b426cd-462b-47a0-8462-2c49213a1147 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:06.307062 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-92b426cd-462b-47a0-8462-2c49213a1147 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:06.307510 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-92b426cd-462b-47a0-8462-2c49213a1147 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:06.308275 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-92b426cd-462b-47a0-8462-2c49213a1147 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:06.308708 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-92b426cd-462b-47a0-8462-2c49213a1147 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:06.445808 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-92b426cd-462b-47a0-8462-2c49213a1147 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:06.453544 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-92b426cd-462b-47a0-8462-2c49213a1147 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.158142 May 26 17:03:06.454469 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 293/612] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:06 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:06.481074 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-fd2c82d3-0e15-47f6-ab45-696ab589831a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:06.485199 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-fd2c82d3-0e15-47f6-ab45-696ab589831a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:06.488711 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fd2c82d3-0e15-47f6-ab45-696ab589831a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:06.489100 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fd2c82d3-0e15-47f6-ab45-696ab589831a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:06.489863 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fd2c82d3-0e15-47f6-ab45-696ab589831a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:06.490695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fd2c82d3-0e15-47f6-ab45-696ab589831a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:06.522352 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-e7e79288-d66d-486f-80da-46d48903a595 req-7c7b848a-1e28-4804-a223-e9ffddc68b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1248649c-ce32-42fd-8764-3a985faf06b8", "name": "network-vif-plugged", "status": "completed", "tag": "55e9f2ec-9d77-41f0-9a91-f494d6cec330"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:06.530856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-e7e79288-d66d-486f-80da-46d48903a595 req-7c7b848a-1e28-4804-a223-e9ffddc68b17 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:06.531368 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-e7e79288-d66d-486f-80da-46d48903a595 req-7c7b848a-1e28-4804-a223-e9ffddc68b17 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:06.543262 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-e7e79288-d66d-486f-80da-46d48903a595 req-7c7b848a-1e28-4804-a223-e9ffddc68b17 service nova] Creating event network-vif-plugged:55e9f2ec-9d77-41f0-9a91-f494d6cec330 for instance 1248649c-ce32-42fd-8764-3a985faf06b8 on hv-cinder-83607 May 26 17:03:06.548838 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-e7e79288-d66d-486f-80da-46d48903a595 req-7c7b848a-1e28-4804-a223-e9ffddc68b17 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030020 May 26 17:03:06.549577 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 294/613] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:03:06.626521 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fd2c82d3-0e15-47f6-ab45-696ab589831a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:06.635137 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fd2c82d3-0e15-47f6-ab45-696ab589831a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:06.636793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fd2c82d3-0e15-47f6-ab45-696ab589831a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:06.637960 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-fd2c82d3-0e15-47f6-ab45-696ab589831a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.160829 May 26 17:03:06.638572 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 320/614] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:06 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:03:06.921083 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3c4fd5e1-c41b-4e9c-93c8-5461718cb02f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:06.921696 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3c4fd5e1-c41b-4e9c-93c8-5461718cb02f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:06.928006 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3c4fd5e1-c41b-4e9c-93c8-5461718cb02f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:06.928458 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3c4fd5e1-c41b-4e9c-93c8-5461718cb02f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:06.929249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3c4fd5e1-c41b-4e9c-93c8-5461718cb02f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:06.929673 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3c4fd5e1-c41b-4e9c-93c8-5461718cb02f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:07.147852 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3c4fd5e1-c41b-4e9c-93c8-5461718cb02f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:07.156680 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3c4fd5e1-c41b-4e9c-93c8-5461718cb02f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.240012 May 26 17:03:07.157312 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 295/615] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:06 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:07.471300 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a3336688-5a5a-4ae0-9aa2-f0c946cc6eb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:07.471831 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a3336688-5a5a-4ae0-9aa2-f0c946cc6eb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:07.477783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a3336688-5a5a-4ae0-9aa2-f0c946cc6eb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:07.478231 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a3336688-5a5a-4ae0-9aa2-f0c946cc6eb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:07.479038 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a3336688-5a5a-4ae0-9aa2-f0c946cc6eb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:07.479505 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a3336688-5a5a-4ae0-9aa2-f0c946cc6eb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:07.605797 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a3336688-5a5a-4ae0-9aa2-f0c946cc6eb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:07.613721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a3336688-5a5a-4ae0-9aa2-f0c946cc6eb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.146545 May 26 17:03:07.614270 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 321/616] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:07 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:07.658855 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-120cf0c2-e29e-4fce-868e-b14eb1979621 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:07.659538 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-120cf0c2-e29e-4fce-868e-b14eb1979621 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:07.665981 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-120cf0c2-e29e-4fce-868e-b14eb1979621 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:07.666459 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-120cf0c2-e29e-4fce-868e-b14eb1979621 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:07.667242 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-120cf0c2-e29e-4fce-868e-b14eb1979621 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:07.667677 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-120cf0c2-e29e-4fce-868e-b14eb1979621 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:07.799153 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-120cf0c2-e29e-4fce-868e-b14eb1979621 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:07.807011 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-120cf0c2-e29e-4fce-868e-b14eb1979621 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:07.808513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-120cf0c2-e29e-4fce-868e-b14eb1979621 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:07.809661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-120cf0c2-e29e-4fce-868e-b14eb1979621 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.155792 May 26 17:03:07.810218 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 296/617] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:07 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:08.175164 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-511a2146-3d01-4089-b520-3760dad9769e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:08.175806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-511a2146-3d01-4089-b520-3760dad9769e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:08.181833 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-511a2146-3d01-4089-b520-3760dad9769e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:08.182276 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-511a2146-3d01-4089-b520-3760dad9769e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:08.183060 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-511a2146-3d01-4089-b520-3760dad9769e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:08.183490 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-511a2146-3d01-4089-b520-3760dad9769e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:08.317924 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-511a2146-3d01-4089-b520-3760dad9769e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:08.325912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-511a2146-3d01-4089-b520-3760dad9769e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.155692 May 26 17:03:08.326509 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 322/618] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:08 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:08.631759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-efb1c9de-63e0-4a86-bfdf-449401b01545 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:08.632273 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-efb1c9de-63e0-4a86-bfdf-449401b01545 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:08.638362 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-efb1c9de-63e0-4a86-bfdf-449401b01545 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:08.638810 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-efb1c9de-63e0-4a86-bfdf-449401b01545 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:08.639566 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-efb1c9de-63e0-4a86-bfdf-449401b01545 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:08.639997 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-efb1c9de-63e0-4a86-bfdf-449401b01545 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:08.775937 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-efb1c9de-63e0-4a86-bfdf-449401b01545 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:08.783364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-efb1c9de-63e0-4a86-bfdf-449401b01545 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.155633 May 26 17:03:08.783929 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 297/619] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:08 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:08.827785 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f9995268-350b-4b32-be2a-cc6e1919141e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:08.828388 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f9995268-350b-4b32-be2a-cc6e1919141e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:08.836020 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f9995268-350b-4b32-be2a-cc6e1919141e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:08.836469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f9995268-350b-4b32-be2a-cc6e1919141e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:08.837240 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f9995268-350b-4b32-be2a-cc6e1919141e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:08.837677 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f9995268-350b-4b32-be2a-cc6e1919141e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:08.973671 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f9995268-350b-4b32-be2a-cc6e1919141e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:08.979112 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f9995268-350b-4b32-be2a-cc6e1919141e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:08.980620 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f9995268-350b-4b32-be2a-cc6e1919141e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:08.981777 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f9995268-350b-4b32-be2a-cc6e1919141e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.157884 May 26 17:03:08.982338 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 323/620] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:08 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:09.343997 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c7f1575f-3e26-4948-815b-205d3103f6b4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:09.345211 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c7f1575f-3e26-4948-815b-205d3103f6b4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:09.351271 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c7f1575f-3e26-4948-815b-205d3103f6b4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:09.351707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c7f1575f-3e26-4948-815b-205d3103f6b4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:09.352465 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c7f1575f-3e26-4948-815b-205d3103f6b4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:09.352903 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c7f1575f-3e26-4948-815b-205d3103f6b4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:09.481724 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c7f1575f-3e26-4948-815b-205d3103f6b4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:09.490378 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c7f1575f-3e26-4948-815b-205d3103f6b4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.150413 May 26 17:03:09.490940 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 298/621] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:09 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:09.800431 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-343afd77-7928-4239-a45c-cb70b9260a55 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:09.800972 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-343afd77-7928-4239-a45c-cb70b9260a55 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:09.806914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-343afd77-7928-4239-a45c-cb70b9260a55 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:09.807356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-343afd77-7928-4239-a45c-cb70b9260a55 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:09.808107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-343afd77-7928-4239-a45c-cb70b9260a55 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:09.808538 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-343afd77-7928-4239-a45c-cb70b9260a55 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:09.940758 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-343afd77-7928-4239-a45c-cb70b9260a55 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:09.948129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-343afd77-7928-4239-a45c-cb70b9260a55 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1370 microversion: 2.1 time: 0.151966 May 26 17:03:09.948686 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 324/622] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:09 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:09.999745 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8f17074f-a5be-48de-943d-7850656762e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:10.000363 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8f17074f-a5be-48de-943d-7850656762e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:10.007266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f17074f-a5be-48de-943d-7850656762e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:10.007732 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f17074f-a5be-48de-943d-7850656762e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:10.008530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f17074f-a5be-48de-943d-7850656762e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:10.008970 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f17074f-a5be-48de-943d-7850656762e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:10.143544 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8f17074f-a5be-48de-943d-7850656762e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:10.151559 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8f17074f-a5be-48de-943d-7850656762e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:10.153059 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8f17074f-a5be-48de-943d-7850656762e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:10.154204 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8f17074f-a5be-48de-943d-7850656762e3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1748 microversion: 2.20 time: 0.158338 May 26 17:03:10.154790 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 299/623] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:09 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:10.508286 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2eb58471-63e7-46c0-b0be-1a68da0991f0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:10.508891 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2eb58471-63e7-46c0-b0be-1a68da0991f0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:10.515028 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2eb58471-63e7-46c0-b0be-1a68da0991f0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:10.515475 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2eb58471-63e7-46c0-b0be-1a68da0991f0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:10.519160 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2eb58471-63e7-46c0-b0be-1a68da0991f0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:10.519160 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2eb58471-63e7-46c0-b0be-1a68da0991f0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:10.651051 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2eb58471-63e7-46c0-b0be-1a68da0991f0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:10.659789 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2eb58471-63e7-46c0-b0be-1a68da0991f0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.155334 May 26 17:03:10.660349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 325/624] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:10 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:10.965882 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-82bb9804-9ccd-4b86-946e-5504314b4760 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:10.966659 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-82bb9804-9ccd-4b86-946e-5504314b4760 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:10.974650 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-82bb9804-9ccd-4b86-946e-5504314b4760 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:10.975098 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-82bb9804-9ccd-4b86-946e-5504314b4760 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:10.975893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-82bb9804-9ccd-4b86-946e-5504314b4760 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:10.976502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-82bb9804-9ccd-4b86-946e-5504314b4760 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:11.118986 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-82bb9804-9ccd-4b86-946e-5504314b4760 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:11.126571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-82bb9804-9ccd-4b86-946e-5504314b4760 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1559 microversion: 2.1 time: 0.164573 May 26 17:03:11.127116 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 300/625] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:10 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:11.143580 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4b680f0d-ab11-4f89-bd75-f8d6df5153d1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:11.144119 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4b680f0d-ab11-4f89-bd75-f8d6df5153d1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:11.150793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4b680f0d-ab11-4f89-bd75-f8d6df5153d1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:11.151449 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4b680f0d-ab11-4f89-bd75-f8d6df5153d1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:11.152436 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4b680f0d-ab11-4f89-bd75-f8d6df5153d1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:11.153020 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4b680f0d-ab11-4f89-bd75-f8d6df5153d1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:11.173848 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b3bfe37b-d772-4be4-985f-a0874a8162ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:11.174489 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b3bfe37b-d772-4be4-985f-a0874a8162ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:11.181025 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b3bfe37b-d772-4be4-985f-a0874a8162ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:11.181543 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b3bfe37b-d772-4be4-985f-a0874a8162ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:11.182587 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b3bfe37b-d772-4be4-985f-a0874a8162ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:11.183117 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b3bfe37b-d772-4be4-985f-a0874a8162ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:11.235997 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4b680f0d-ab11-4f89-bd75-f8d6df5153d1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096609 May 26 17:03:11.236645 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 326/626] 10.222.0.112 () {58 vars in 1279 bytes} [Thu May 26 17:03:11 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:03:11.322731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b3bfe37b-d772-4be4-985f-a0874a8162ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:11.332609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b3bfe37b-d772-4be4-985f-a0874a8162ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:11.334598 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b3bfe37b-d772-4be4-985f-a0874a8162ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:11.335805 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b3bfe37b-d772-4be4-985f-a0874a8162ff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1748 microversion: 2.20 time: 0.165980 May 26 17:03:11.336403 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 301/627] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:11 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:11.676698 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-79f635ca-3c34-4e01-9e55-4a91b3090f33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:11.677311 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-79f635ca-3c34-4e01-9e55-4a91b3090f33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:11.683301 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-79f635ca-3c34-4e01-9e55-4a91b3090f33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:11.683753 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-79f635ca-3c34-4e01-9e55-4a91b3090f33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:11.684512 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-79f635ca-3c34-4e01-9e55-4a91b3090f33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:11.684947 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-79f635ca-3c34-4e01-9e55-4a91b3090f33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:11.891962 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-79f635ca-3c34-4e01-9e55-4a91b3090f33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:11.900040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-79f635ca-3c34-4e01-9e55-4a91b3090f33 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.227317 May 26 17:03:11.900610 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 327/628] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:11 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:12.256135 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-ef722527-8b32-49d9-922e-01602809bc7c req-203fbb5b-5332-486b-97c1-ecb3c511c142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1248649c-ce32-42fd-8764-3a985faf06b8", "tag": "55e9f2ec-9d77-41f0-9a91-f494d6cec330"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:12.265043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-ef722527-8b32-49d9-922e-01602809bc7c req-203fbb5b-5332-486b-97c1-ecb3c511c142 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:12.265492 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-ef722527-8b32-49d9-922e-01602809bc7c req-203fbb5b-5332-486b-97c1-ecb3c511c142 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:12.277416 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-ef722527-8b32-49d9-922e-01602809bc7c req-203fbb5b-5332-486b-97c1-ecb3c511c142 service nova] Creating event network-changed:55e9f2ec-9d77-41f0-9a91-f494d6cec330 for instance 1248649c-ce32-42fd-8764-3a985faf06b8 on hv-cinder-83607 May 26 17:03:12.283347 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-ef722527-8b32-49d9-922e-01602809bc7c req-203fbb5b-5332-486b-97c1-ecb3c511c142 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030675 May 26 17:03:12.283867 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 302/629] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:03:12.355007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-95cd4bb1-4b94-4cad-8855-72abaca88b01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:12.357963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-95cd4bb1-4b94-4cad-8855-72abaca88b01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:12.363883 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-95cd4bb1-4b94-4cad-8855-72abaca88b01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:12.364335 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-95cd4bb1-4b94-4cad-8855-72abaca88b01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:12.365108 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-95cd4bb1-4b94-4cad-8855-72abaca88b01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:12.365688 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-95cd4bb1-4b94-4cad-8855-72abaca88b01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:12.475324 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-60dfc9fb-7b1d-44ae-877b-b42322cf13f6 req-0f8bda91-11ad-4c66-8efc-7aec0bcc4973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e5f6d0-3136-4741-a4c4-916b792ee1c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf8c749f-cafe-414f-850e-85d42f33c2db"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:12.485818 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-60dfc9fb-7b1d-44ae-877b-b42322cf13f6 req-0f8bda91-11ad-4c66-8efc-7aec0bcc4973 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:12.486695 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-60dfc9fb-7b1d-44ae-877b-b42322cf13f6 req-0f8bda91-11ad-4c66-8efc-7aec0bcc4973 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:12.502571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-60dfc9fb-7b1d-44ae-877b-b42322cf13f6 req-0f8bda91-11ad-4c66-8efc-7aec0bcc4973 service nova] Creating event network-vif-plugged:bf8c749f-cafe-414f-850e-85d42f33c2db for instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 on hv-cinder-83607 May 26 17:03:12.508176 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-60dfc9fb-7b1d-44ae-877b-b42322cf13f6 req-0f8bda91-11ad-4c66-8efc-7aec0bcc4973 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036971 May 26 17:03:12.513465 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 303/630] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:03:12.515879 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-95cd4bb1-4b94-4cad-8855-72abaca88b01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:12.524098 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-95cd4bb1-4b94-4cad-8855-72abaca88b01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:12.525589 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-95cd4bb1-4b94-4cad-8855-72abaca88b01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:12.526783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-95cd4bb1-4b94-4cad-8855-72abaca88b01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1748 microversion: 2.20 time: 0.175938 May 26 17:03:12.527347 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 328/631] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:12 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:12.919245 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7205878e-b2e6-456a-8b99-949adbf57ad6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:12.919943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7205878e-b2e6-456a-8b99-949adbf57ad6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:12.927511 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7205878e-b2e6-456a-8b99-949adbf57ad6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:12.928350 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7205878e-b2e6-456a-8b99-949adbf57ad6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:12.929326 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7205878e-b2e6-456a-8b99-949adbf57ad6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:12.929936 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7205878e-b2e6-456a-8b99-949adbf57ad6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:13.067292 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7205878e-b2e6-456a-8b99-949adbf57ad6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:13.076099 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7205878e-b2e6-456a-8b99-949adbf57ad6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.160757 May 26 17:03:13.076691 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 304/632] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:12 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:13.545189 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8f2dae0f-f6ab-4032-b7db-5d1d1dd44506 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:13.545799 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8f2dae0f-f6ab-4032-b7db-5d1d1dd44506 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:13.552570 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8f2dae0f-f6ab-4032-b7db-5d1d1dd44506 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:13.553029 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8f2dae0f-f6ab-4032-b7db-5d1d1dd44506 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:13.553789 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8f2dae0f-f6ab-4032-b7db-5d1d1dd44506 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:13.554224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8f2dae0f-f6ab-4032-b7db-5d1d1dd44506 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:13.556774 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:13.684632 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8f2dae0f-f6ab-4032-b7db-5d1d1dd44506 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:13.693031 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8f2dae0f-f6ab-4032-b7db-5d1d1dd44506 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:13.694562 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8f2dae0f-f6ab-4032-b7db-5d1d1dd44506 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:13.695740 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8f2dae0f-f6ab-4032-b7db-5d1d1dd44506 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1748 microversion: 2.20 time: 0.154529 May 26 17:03:13.696304 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 329/633] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:13 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:14.093179 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-27328c49-63a7-4d00-99e4-c2582ceeedc1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:14.093919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-27328c49-63a7-4d00-99e4-c2582ceeedc1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:14.101417 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-27328c49-63a7-4d00-99e4-c2582ceeedc1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:14.101874 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-27328c49-63a7-4d00-99e4-c2582ceeedc1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:14.102691 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-27328c49-63a7-4d00-99e4-c2582ceeedc1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:14.103134 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-27328c49-63a7-4d00-99e4-c2582ceeedc1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:14.237759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-27328c49-63a7-4d00-99e4-c2582ceeedc1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:14.245644 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-27328c49-63a7-4d00-99e4-c2582ceeedc1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.156391 May 26 17:03:14.246206 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 305/634] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:14 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:14.713673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-95e201c6-0429-4491-8f0f-48189cdbe114 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:14.714287 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-95e201c6-0429-4491-8f0f-48189cdbe114 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:14.721149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-95e201c6-0429-4491-8f0f-48189cdbe114 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:14.721596 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-95e201c6-0429-4491-8f0f-48189cdbe114 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:14.722396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-95e201c6-0429-4491-8f0f-48189cdbe114 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:14.722836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-95e201c6-0429-4491-8f0f-48189cdbe114 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:14.852971 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-95e201c6-0429-4491-8f0f-48189cdbe114 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:14.861367 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-95e201c6-0429-4491-8f0f-48189cdbe114 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:14.862882 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-95e201c6-0429-4491-8f0f-48189cdbe114 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:14.864023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-95e201c6-0429-4491-8f0f-48189cdbe114 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1748 microversion: 2.20 time: 0.154243 May 26 17:03:14.864826 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 330/635] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:14 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:15.263675 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e27b00f9-c641-42d8-adbb-847a51d6fb5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:15.264288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e27b00f9-c641-42d8-adbb-847a51d6fb5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:15.270917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e27b00f9-c641-42d8-adbb-847a51d6fb5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:15.271373 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e27b00f9-c641-42d8-adbb-847a51d6fb5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:15.272244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e27b00f9-c641-42d8-adbb-847a51d6fb5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:15.272685 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e27b00f9-c641-42d8-adbb-847a51d6fb5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:15.402010 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e27b00f9-c641-42d8-adbb-847a51d6fb5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:15.410687 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e27b00f9-c641-42d8-adbb-847a51d6fb5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.150914 May 26 17:03:15.411255 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 306/636] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:15 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:15.883137 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0c5c073c-9a0f-42ae-8463-dec4af7b32d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:15.883753 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0c5c073c-9a0f-42ae-8463-dec4af7b32d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:15.890363 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0c5c073c-9a0f-42ae-8463-dec4af7b32d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:15.890813 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0c5c073c-9a0f-42ae-8463-dec4af7b32d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:15.892767 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0c5c073c-9a0f-42ae-8463-dec4af7b32d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:15.893188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0c5c073c-9a0f-42ae-8463-dec4af7b32d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:16.020145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0c5c073c-9a0f-42ae-8463-dec4af7b32d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:16.027990 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0c5c073c-9a0f-42ae-8463-dec4af7b32d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:16.029475 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0c5c073c-9a0f-42ae-8463-dec4af7b32d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:16.030647 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0c5c073c-9a0f-42ae-8463-dec4af7b32d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1748 microversion: 2.20 time: 0.151500 May 26 17:03:16.031215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 331/637] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:15 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:16.428055 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5a969f0c-1de5-41bd-b69d-26aac7be5004 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:16.428673 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5a969f0c-1de5-41bd-b69d-26aac7be5004 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:16.435081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5a969f0c-1de5-41bd-b69d-26aac7be5004 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:16.435534 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5a969f0c-1de5-41bd-b69d-26aac7be5004 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:16.436294 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5a969f0c-1de5-41bd-b69d-26aac7be5004 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:16.436730 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5a969f0c-1de5-41bd-b69d-26aac7be5004 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:16.570129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5a969f0c-1de5-41bd-b69d-26aac7be5004 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:16.578841 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5a969f0c-1de5-41bd-b69d-26aac7be5004 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1705 microversion: 2.1 time: 0.154768 May 26 17:03:16.583699 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 307/638] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:16 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1705 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:16.596334 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-46e4fae9-f426-40d9-a3bc-3d850ff1b0f1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:16.602346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-46e4fae9-f426-40d9-a3bc-3d850ff1b0f1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:16.602821 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-46e4fae9-f426-40d9-a3bc-3d850ff1b0f1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:16.624605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-46e4fae9-f426-40d9-a3bc-3d850ff1b0f1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Going to try to start instance {{(pid=130526) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 17:03:16.806636 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-46e4fae9-f426-40d9-a3bc-3d850ff1b0f1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "POST /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/action" status: 202 len: 0 microversion: 2.1 time: 0.213916 May 26 17:03:16.807149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 332/639] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:03:16 2022] POST /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:03:16.815672 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4e13a07f-3e1b-462b-980c-9ce2825444db tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:16.816308 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4e13a07f-3e1b-462b-980c-9ce2825444db tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:16.822560 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e13a07f-3e1b-462b-980c-9ce2825444db tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:16.832950 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e13a07f-3e1b-462b-980c-9ce2825444db tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:16.832950 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e13a07f-3e1b-462b-980c-9ce2825444db tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:16.832950 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e13a07f-3e1b-462b-980c-9ce2825444db tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:16.965330 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4e13a07f-3e1b-462b-980c-9ce2825444db tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:16.975902 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4e13a07f-3e1b-462b-980c-9ce2825444db tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1714 microversion: 2.1 time: 0.164468 May 26 17:03:16.976546 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 308/640] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:16 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:17.049951 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b22c5f08-fd0c-4b58-9dbc-ca45f00924cb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:17.050664 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b22c5f08-fd0c-4b58-9dbc-ca45f00924cb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:17.057786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b22c5f08-fd0c-4b58-9dbc-ca45f00924cb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:17.058173 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b22c5f08-fd0c-4b58-9dbc-ca45f00924cb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:17.058962 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b22c5f08-fd0c-4b58-9dbc-ca45f00924cb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:17.059366 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b22c5f08-fd0c-4b58-9dbc-ca45f00924cb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:17.197301 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b22c5f08-fd0c-4b58-9dbc-ca45f00924cb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:17.205996 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b22c5f08-fd0c-4b58-9dbc-ca45f00924cb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:17.207887 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b22c5f08-fd0c-4b58-9dbc-ca45f00924cb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:17.209070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b22c5f08-fd0c-4b58-9dbc-ca45f00924cb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1748 microversion: 2.20 time: 0.163785 May 26 17:03:17.209625 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 333/641] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:17 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:17.994657 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-31d9aaeb-cf6b-4893-86e0-7568ae85771e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:17.995268 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-31d9aaeb-cf6b-4893-86e0-7568ae85771e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:18.002494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-31d9aaeb-cf6b-4893-86e0-7568ae85771e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:18.002945 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-31d9aaeb-cf6b-4893-86e0-7568ae85771e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:18.003708 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-31d9aaeb-cf6b-4893-86e0-7568ae85771e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:18.004142 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-31d9aaeb-cf6b-4893-86e0-7568ae85771e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:18.006800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:18.135993 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-31d9aaeb-cf6b-4893-86e0-7568ae85771e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:18.144718 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-31d9aaeb-cf6b-4893-86e0-7568ae85771e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1714 microversion: 2.1 time: 0.153857 May 26 17:03:18.145303 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 309/642] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:17 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:18.227885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-52261a7d-2199-44db-be23-93a6bcd8ad7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:18.228507 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-52261a7d-2199-44db-be23-93a6bcd8ad7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:18.235582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52261a7d-2199-44db-be23-93a6bcd8ad7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:18.236040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52261a7d-2199-44db-be23-93a6bcd8ad7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:18.236785 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52261a7d-2199-44db-be23-93a6bcd8ad7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:18.237210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52261a7d-2199-44db-be23-93a6bcd8ad7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:18.364777 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-52261a7d-2199-44db-be23-93a6bcd8ad7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:18.372600 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-52261a7d-2199-44db-be23-93a6bcd8ad7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:18.374102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-52261a7d-2199-44db-be23-93a6bcd8ad7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:18.375286 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-52261a7d-2199-44db-be23-93a6bcd8ad7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1748 microversion: 2.20 time: 0.151250 May 26 17:03:18.376040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 334/643] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:18 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:19.162289 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a347f58d-a2cf-426a-9b50-a5da1b6ccb7f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:19.162946 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a347f58d-a2cf-426a-9b50-a5da1b6ccb7f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:19.169378 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a347f58d-a2cf-426a-9b50-a5da1b6ccb7f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:19.169822 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a347f58d-a2cf-426a-9b50-a5da1b6ccb7f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:19.170608 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a347f58d-a2cf-426a-9b50-a5da1b6ccb7f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:19.171047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a347f58d-a2cf-426a-9b50-a5da1b6ccb7f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:19.308890 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a347f58d-a2cf-426a-9b50-a5da1b6ccb7f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:19.317002 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a347f58d-a2cf-426a-9b50-a5da1b6ccb7f tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1714 microversion: 2.1 time: 0.158612 May 26 17:03:19.317565 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 310/644] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:19 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:19.393562 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a9f88bdc-f196-4c9a-8813-3fcfb73ca6a0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:19.394146 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a9f88bdc-f196-4c9a-8813-3fcfb73ca6a0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:19.400594 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a9f88bdc-f196-4c9a-8813-3fcfb73ca6a0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:19.401037 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a9f88bdc-f196-4c9a-8813-3fcfb73ca6a0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:19.401787 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a9f88bdc-f196-4c9a-8813-3fcfb73ca6a0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:19.402215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a9f88bdc-f196-4c9a-8813-3fcfb73ca6a0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:19.534346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a9f88bdc-f196-4c9a-8813-3fcfb73ca6a0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:19.542859 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a9f88bdc-f196-4c9a-8813-3fcfb73ca6a0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:19.544458 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a9f88bdc-f196-4c9a-8813-3fcfb73ca6a0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:19.545798 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a9f88bdc-f196-4c9a-8813-3fcfb73ca6a0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1748 microversion: 2.20 time: 0.156634 May 26 17:03:19.546485 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 335/645] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:19 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:20.333673 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-88bd6b66-2d57-477c-9485-0744b1cf3236 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:20.334284 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-88bd6b66-2d57-477c-9485-0744b1cf3236 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:20.340866 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-88bd6b66-2d57-477c-9485-0744b1cf3236 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:20.356539 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-88bd6b66-2d57-477c-9485-0744b1cf3236 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:20.356539 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-88bd6b66-2d57-477c-9485-0744b1cf3236 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:20.356539 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-88bd6b66-2d57-477c-9485-0744b1cf3236 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:20.479147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-88bd6b66-2d57-477c-9485-0744b1cf3236 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:20.487725 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-88bd6b66-2d57-477c-9485-0744b1cf3236 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1718 microversion: 2.1 time: 0.158148 May 26 17:03:20.488295 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 311/646] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:20 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:20.567897 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-157a4d6f-fa0b-465b-83fa-610bbd0745b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:20.568506 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-157a4d6f-fa0b-465b-83fa-610bbd0745b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:20.575119 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-157a4d6f-fa0b-465b-83fa-610bbd0745b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:20.575570 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-157a4d6f-fa0b-465b-83fa-610bbd0745b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:20.576338 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-157a4d6f-fa0b-465b-83fa-610bbd0745b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:20.576775 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-157a4d6f-fa0b-465b-83fa-610bbd0745b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:20.723213 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-157a4d6f-fa0b-465b-83fa-610bbd0745b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:20.733334 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-157a4d6f-fa0b-465b-83fa-610bbd0745b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:20.735593 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-157a4d6f-fa0b-465b-83fa-610bbd0745b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:20.738078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-157a4d6f-fa0b-465b-83fa-610bbd0745b9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.173984 May 26 17:03:20.738676 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 336/647] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:20 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:21.756358 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-472450b1-6059-4e12-bb57-7a9d03844719 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:21.756976 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-472450b1-6059-4e12-bb57-7a9d03844719 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:21.763451 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-472450b1-6059-4e12-bb57-7a9d03844719 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:21.763904 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-472450b1-6059-4e12-bb57-7a9d03844719 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:21.764662 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-472450b1-6059-4e12-bb57-7a9d03844719 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:21.765098 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-472450b1-6059-4e12-bb57-7a9d03844719 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:21.900471 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-472450b1-6059-4e12-bb57-7a9d03844719 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:21.912272 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-472450b1-6059-4e12-bb57-7a9d03844719 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:21.915853 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-472450b1-6059-4e12-bb57-7a9d03844719 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:21.917071 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-472450b1-6059-4e12-bb57-7a9d03844719 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.164655 May 26 17:03:21.917628 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 312/648] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:21 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:22.936229 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a80a7db5-9b17-40c2-86af-a5536d17300d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:22.936859 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a80a7db5-9b17-40c2-86af-a5536d17300d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:22.944002 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a80a7db5-9b17-40c2-86af-a5536d17300d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:22.944449 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a80a7db5-9b17-40c2-86af-a5536d17300d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:22.945219 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a80a7db5-9b17-40c2-86af-a5536d17300d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:22.945640 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a80a7db5-9b17-40c2-86af-a5536d17300d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:23.081035 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a80a7db5-9b17-40c2-86af-a5536d17300d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:23.089412 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a80a7db5-9b17-40c2-86af-a5536d17300d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:23.090958 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a80a7db5-9b17-40c2-86af-a5536d17300d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:23.092177 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a80a7db5-9b17-40c2-86af-a5536d17300d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.159748 May 26 17:03:23.103049 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 337/649] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:22 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:24.110802 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8e1e2755-e1f5-43fd-8045-3ee439b27136 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:24.111563 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8e1e2755-e1f5-43fd-8045-3ee439b27136 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:24.117897 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8e1e2755-e1f5-43fd-8045-3ee439b27136 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:24.118352 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8e1e2755-e1f5-43fd-8045-3ee439b27136 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:24.119178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8e1e2755-e1f5-43fd-8045-3ee439b27136 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:24.119609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8e1e2755-e1f5-43fd-8045-3ee439b27136 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:24.284099 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8e1e2755-e1f5-43fd-8045-3ee439b27136 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:24.292548 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8e1e2755-e1f5-43fd-8045-3ee439b27136 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:24.293663 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8e1e2755-e1f5-43fd-8045-3ee439b27136 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:24.294862 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8e1e2755-e1f5-43fd-8045-3ee439b27136 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.188158 May 26 17:03:24.295415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 313/650] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:24 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:25.314385 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0d32fdc6-ca53-4ae9-8916-53afe02bb3ab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:25.315018 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0d32fdc6-ca53-4ae9-8916-53afe02bb3ab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:25.317590 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=74 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:25.323935 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0d32fdc6-ca53-4ae9-8916-53afe02bb3ab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:25.324384 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0d32fdc6-ca53-4ae9-8916-53afe02bb3ab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:25.325139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0d32fdc6-ca53-4ae9-8916-53afe02bb3ab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:25.325570 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0d32fdc6-ca53-4ae9-8916-53afe02bb3ab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:25.466178 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0d32fdc6-ca53-4ae9-8916-53afe02bb3ab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:25.474565 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0d32fdc6-ca53-4ae9-8916-53afe02bb3ab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:25.476137 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0d32fdc6-ca53-4ae9-8916-53afe02bb3ab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:25.477264 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0d32fdc6-ca53-4ae9-8916-53afe02bb3ab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.167514 May 26 17:03:25.477870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 338/651] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:25 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:26.495537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-11b9d690-7b91-40e2-ae89-d5f9d75ac717 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:26.496108 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-11b9d690-7b91-40e2-ae89-d5f9d75ac717 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:26.498513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=74 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:26.503562 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-11b9d690-7b91-40e2-ae89-d5f9d75ac717 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:26.504026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-11b9d690-7b91-40e2-ae89-d5f9d75ac717 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:26.504806 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-11b9d690-7b91-40e2-ae89-d5f9d75ac717 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:26.505244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-11b9d690-7b91-40e2-ae89-d5f9d75ac717 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:26.642571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-11b9d690-7b91-40e2-ae89-d5f9d75ac717 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:26.650562 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-11b9d690-7b91-40e2-ae89-d5f9d75ac717 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:26.652082 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-11b9d690-7b91-40e2-ae89-d5f9d75ac717 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:26.653234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-11b9d690-7b91-40e2-ae89-d5f9d75ac717 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.161757 May 26 17:03:26.653835 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 314/652] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:26 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:27.674483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d1cf1b6f-71f3-4fea-9f57-175187e86e77 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:27.675182 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d1cf1b6f-71f3-4fea-9f57-175187e86e77 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:27.686340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d1cf1b6f-71f3-4fea-9f57-175187e86e77 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:27.687038 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d1cf1b6f-71f3-4fea-9f57-175187e86e77 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:27.688113 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d1cf1b6f-71f3-4fea-9f57-175187e86e77 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:27.689908 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d1cf1b6f-71f3-4fea-9f57-175187e86e77 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:27.828259 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d1cf1b6f-71f3-4fea-9f57-175187e86e77 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:27.837055 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d1cf1b6f-71f3-4fea-9f57-175187e86e77 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:27.838598 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d1cf1b6f-71f3-4fea-9f57-175187e86e77 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:27.839762 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d1cf1b6f-71f3-4fea-9f57-175187e86e77 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.170177 May 26 17:03:27.840496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 339/653] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:27 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:28.861839 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-30b9012e-cfe2-41a6-b9df-08ed4046ea3b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:28.863535 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-30b9012e-cfe2-41a6-b9df-08ed4046ea3b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:28.869138 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-30b9012e-cfe2-41a6-b9df-08ed4046ea3b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:28.869594 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-30b9012e-cfe2-41a6-b9df-08ed4046ea3b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:28.870401 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-30b9012e-cfe2-41a6-b9df-08ed4046ea3b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:28.870842 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-30b9012e-cfe2-41a6-b9df-08ed4046ea3b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:29.032236 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-30b9012e-cfe2-41a6-b9df-08ed4046ea3b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:29.042015 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-30b9012e-cfe2-41a6-b9df-08ed4046ea3b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:29.043560 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-30b9012e-cfe2-41a6-b9df-08ed4046ea3b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:29.044853 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-30b9012e-cfe2-41a6-b9df-08ed4046ea3b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.187126 May 26 17:03:29.045631 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 315/654] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:28 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:30.065925 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0efa2e44-b841-4563-b957-39c2337b1f37 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:30.066639 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0efa2e44-b841-4563-b957-39c2337b1f37 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:30.073772 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0efa2e44-b841-4563-b957-39c2337b1f37 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:30.074244 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0efa2e44-b841-4563-b957-39c2337b1f37 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:30.075042 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0efa2e44-b841-4563-b957-39c2337b1f37 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:30.075471 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0efa2e44-b841-4563-b957-39c2337b1f37 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:30.220695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0efa2e44-b841-4563-b957-39c2337b1f37 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:30.229228 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0efa2e44-b841-4563-b957-39c2337b1f37 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:30.230739 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0efa2e44-b841-4563-b957-39c2337b1f37 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:30.231988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0efa2e44-b841-4563-b957-39c2337b1f37 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.171148 May 26 17:03:30.232537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 340/655] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:30 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:31.252098 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4072bab3-df23-4bb4-9d81-bf914427c507 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:31.253258 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4072bab3-df23-4bb4-9d81-bf914427c507 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:31.261160 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4072bab3-df23-4bb4-9d81-bf914427c507 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:31.261604 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4072bab3-df23-4bb4-9d81-bf914427c507 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:31.262398 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4072bab3-df23-4bb4-9d81-bf914427c507 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:31.262836 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4072bab3-df23-4bb4-9d81-bf914427c507 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:31.399834 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4072bab3-df23-4bb4-9d81-bf914427c507 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:31.408013 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4072bab3-df23-4bb4-9d81-bf914427c507 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:31.410766 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4072bab3-df23-4bb4-9d81-bf914427c507 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:31.411941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4072bab3-df23-4bb4-9d81-bf914427c507 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.163876 May 26 17:03:31.412678 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 316/656] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:31 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:32.430844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-63ced9e2-5f90-4d14-ba01-b354712b5f38 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:32.431410 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-63ced9e2-5f90-4d14-ba01-b354712b5f38 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:32.437765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-63ced9e2-5f90-4d14-ba01-b354712b5f38 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:32.438221 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-63ced9e2-5f90-4d14-ba01-b354712b5f38 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:32.439026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-63ced9e2-5f90-4d14-ba01-b354712b5f38 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:32.439461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-63ced9e2-5f90-4d14-ba01-b354712b5f38 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:32.597005 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-63ced9e2-5f90-4d14-ba01-b354712b5f38 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:32.605810 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-63ced9e2-5f90-4d14-ba01-b354712b5f38 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:32.611523 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-63ced9e2-5f90-4d14-ba01-b354712b5f38 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:32.612845 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-63ced9e2-5f90-4d14-ba01-b354712b5f38 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.185963 May 26 17:03:32.613518 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 341/657] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:32 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:33.633544 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9e3f0fcc-f372-4f5e-a032-ebc13e2ff09f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:33.634091 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9e3f0fcc-f372-4f5e-a032-ebc13e2ff09f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:33.640891 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9e3f0fcc-f372-4f5e-a032-ebc13e2ff09f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:33.641355 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9e3f0fcc-f372-4f5e-a032-ebc13e2ff09f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:33.642130 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9e3f0fcc-f372-4f5e-a032-ebc13e2ff09f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:33.642584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9e3f0fcc-f372-4f5e-a032-ebc13e2ff09f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:33.812369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9e3f0fcc-f372-4f5e-a032-ebc13e2ff09f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:33.821943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9e3f0fcc-f372-4f5e-a032-ebc13e2ff09f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:33.823492 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9e3f0fcc-f372-4f5e-a032-ebc13e2ff09f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:33.824648 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9e3f0fcc-f372-4f5e-a032-ebc13e2ff09f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.195162 May 26 17:03:33.825221 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 317/658] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:33 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:34.845022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-93a13b5f-d943-40e6-8ce6-9936fbc8ce30 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:34.845619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-93a13b5f-d943-40e6-8ce6-9936fbc8ce30 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:34.852802 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-93a13b5f-d943-40e6-8ce6-9936fbc8ce30 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:34.853253 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-93a13b5f-d943-40e6-8ce6-9936fbc8ce30 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:34.854026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-93a13b5f-d943-40e6-8ce6-9936fbc8ce30 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:34.854503 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-93a13b5f-d943-40e6-8ce6-9936fbc8ce30 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:34.985366 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-93a13b5f-d943-40e6-8ce6-9936fbc8ce30 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:34.993881 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-93a13b5f-d943-40e6-8ce6-9936fbc8ce30 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:35.000560 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-93a13b5f-d943-40e6-8ce6-9936fbc8ce30 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:35.001877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-93a13b5f-d943-40e6-8ce6-9936fbc8ce30 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.160712 May 26 17:03:35.003007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 342/659] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:34 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:36.021731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ed42cea4-4dc9-4b6e-8845-291a83fdea9c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:36.022309 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ed42cea4-4dc9-4b6e-8845-291a83fdea9c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:36.029109 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed42cea4-4dc9-4b6e-8845-291a83fdea9c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:36.029552 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed42cea4-4dc9-4b6e-8845-291a83fdea9c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:36.030339 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed42cea4-4dc9-4b6e-8845-291a83fdea9c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:36.030773 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed42cea4-4dc9-4b6e-8845-291a83fdea9c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:36.165512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ed42cea4-4dc9-4b6e-8845-291a83fdea9c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:36.173291 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ed42cea4-4dc9-4b6e-8845-291a83fdea9c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:36.175458 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ed42cea4-4dc9-4b6e-8845-291a83fdea9c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:36.176603 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ed42cea4-4dc9-4b6e-8845-291a83fdea9c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.159479 May 26 17:03:36.177164 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 318/660] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:36 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:37.195772 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5e5f7edb-485c-4d30-9d60-73556785c1e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:37.196315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5e5f7edb-485c-4d30-9d60-73556785c1e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:37.202861 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5e5f7edb-485c-4d30-9d60-73556785c1e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:37.203312 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5e5f7edb-485c-4d30-9d60-73556785c1e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:37.204082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5e5f7edb-485c-4d30-9d60-73556785c1e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:37.204518 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5e5f7edb-485c-4d30-9d60-73556785c1e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:37.336846 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5e5f7edb-485c-4d30-9d60-73556785c1e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:37.344729 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5e5f7edb-485c-4d30-9d60-73556785c1e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:37.347015 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5e5f7edb-485c-4d30-9d60-73556785c1e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:37.348173 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5e5f7edb-485c-4d30-9d60-73556785c1e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1743 microversion: 2.20 time: 0.156362 May 26 17:03:37.348736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 343/661] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:37 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:38.366596 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0841405e-b677-49e4-b038-04ac05640243 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:38.367219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0841405e-b677-49e4-b038-04ac05640243 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:38.374144 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0841405e-b677-49e4-b038-04ac05640243 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:38.374622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0841405e-b677-49e4-b038-04ac05640243 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:38.375393 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0841405e-b677-49e4-b038-04ac05640243 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:38.375829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0841405e-b677-49e4-b038-04ac05640243 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:38.603295 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0841405e-b677-49e4-b038-04ac05640243 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:38.611884 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0841405e-b677-49e4-b038-04ac05640243 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:38.613435 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0841405e-b677-49e4-b038-04ac05640243 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:38.614759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0841405e-b677-49e4-b038-04ac05640243 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1725 microversion: 2.20 time: 0.252204 May 26 17:03:38.615406 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 319/662] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:38 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:39.633266 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4afcde6e-845e-4bd6-8658-76b4392f7493 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:39.633865 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4afcde6e-845e-4bd6-8658-76b4392f7493 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:39.640438 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4afcde6e-845e-4bd6-8658-76b4392f7493 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:39.640882 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4afcde6e-845e-4bd6-8658-76b4392f7493 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:39.641631 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4afcde6e-845e-4bd6-8658-76b4392f7493 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:39.642180 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4afcde6e-845e-4bd6-8658-76b4392f7493 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:39.770680 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4afcde6e-845e-4bd6-8658-76b4392f7493 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:39.772952 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:39.779238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4afcde6e-845e-4bd6-8658-76b4392f7493 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:39.780770 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4afcde6e-845e-4bd6-8658-76b4392f7493 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:39.781957 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4afcde6e-845e-4bd6-8658-76b4392f7493 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1725 microversion: 2.20 time: 0.152609 May 26 17:03:39.782551 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 344/663] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:39 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:40.801637 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fec99a79-42db-443b-8a62-57a04346d5fe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:40.802234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fec99a79-42db-443b-8a62-57a04346d5fe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:40.808508 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fec99a79-42db-443b-8a62-57a04346d5fe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:40.808954 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fec99a79-42db-443b-8a62-57a04346d5fe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:40.809722 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fec99a79-42db-443b-8a62-57a04346d5fe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:40.810153 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fec99a79-42db-443b-8a62-57a04346d5fe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:40.948951 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fec99a79-42db-443b-8a62-57a04346d5fe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:40.957923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fec99a79-42db-443b-8a62-57a04346d5fe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:40.959476 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fec99a79-42db-443b-8a62-57a04346d5fe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:40.960632 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fec99a79-42db-443b-8a62-57a04346d5fe tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1725 microversion: 2.20 time: 0.163495 May 26 17:03:40.961203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 320/664] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:40 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:41.980033 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9951e886-b6c0-401e-9ce8-bcff3111986d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:41.980675 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9951e886-b6c0-401e-9ce8-bcff3111986d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:41.988653 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9951e886-b6c0-401e-9ce8-bcff3111986d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:41.989109 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9951e886-b6c0-401e-9ce8-bcff3111986d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:41.989876 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9951e886-b6c0-401e-9ce8-bcff3111986d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:41.990337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9951e886-b6c0-401e-9ce8-bcff3111986d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:42.123758 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9951e886-b6c0-401e-9ce8-bcff3111986d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:42.132041 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9951e886-b6c0-401e-9ce8-bcff3111986d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:42.133528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9951e886-b6c0-401e-9ce8-bcff3111986d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:42.134704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9951e886-b6c0-401e-9ce8-bcff3111986d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1725 microversion: 2.20 time: 0.158587 May 26 17:03:42.135259 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 345/665] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:41 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:42.581299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-5bdda311-94c8-4064-b4b5-2813d4ffb906 req-9f4db502-3389-4613-8fa7-0a28fe388ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e5f6d0-3136-4741-a4c4-916b792ee1c8", "name": "network-vif-unplugged", "status": "completed", "tag": "bf8c749f-cafe-414f-850e-85d42f33c2db"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:42.590286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-5bdda311-94c8-4064-b4b5-2813d4ffb906 req-9f4db502-3389-4613-8fa7-0a28fe388ff1 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:42.590752 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-5bdda311-94c8-4064-b4b5-2813d4ffb906 req-9f4db502-3389-4613-8fa7-0a28fe388ff1 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:42.603953 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-5bdda311-94c8-4064-b4b5-2813d4ffb906 req-9f4db502-3389-4613-8fa7-0a28fe388ff1 service nova] Creating event network-vif-unplugged:bf8c749f-cafe-414f-850e-85d42f33c2db for instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 on hv-cinder-83607 May 26 17:03:42.609175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-5bdda311-94c8-4064-b4b5-2813d4ffb906 req-9f4db502-3389-4613-8fa7-0a28fe388ff1 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032318 May 26 17:03:42.609755 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 321/666] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:03:43.153313 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c46bfdaf-ecaa-4016-a988-04d02f12ddf0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:43.153922 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c46bfdaf-ecaa-4016-a988-04d02f12ddf0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:43.161080 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c46bfdaf-ecaa-4016-a988-04d02f12ddf0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:43.161527 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c46bfdaf-ecaa-4016-a988-04d02f12ddf0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:43.162292 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c46bfdaf-ecaa-4016-a988-04d02f12ddf0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:43.162750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c46bfdaf-ecaa-4016-a988-04d02f12ddf0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:43.294038 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c46bfdaf-ecaa-4016-a988-04d02f12ddf0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:43.302598 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c46bfdaf-ecaa-4016-a988-04d02f12ddf0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:43.304111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c46bfdaf-ecaa-4016-a988-04d02f12ddf0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:43.305276 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c46bfdaf-ecaa-4016-a988-04d02f12ddf0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1728 microversion: 2.20 time: 0.156194 May 26 17:03:43.305833 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 346/667] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:43 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:43.327611 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f1216b7d-bac5-40ad-8b50-63e12c9cf7e0 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:43.328203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-33b9f15a-3ab3-426f-9a65-d70dd8287d0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6a3fd2a-5c87-4783-83a9-a0246b8c86cc"}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:43.328644 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f1216b7d-bac5-40ad-8b50-63e12c9cf7e0 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:43.329336 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-33b9f15a-3ab3-426f-9a65-d70dd8287d0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:43.335845 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f1216b7d-bac5-40ad-8b50-63e12c9cf7e0 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:43.336300 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f1216b7d-bac5-40ad-8b50-63e12c9cf7e0 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:43.337030 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-33b9f15a-3ab3-426f-9a65-d70dd8287d0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:43.337163 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f1216b7d-bac5-40ad-8b50-63e12c9cf7e0 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:43.337476 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-33b9f15a-3ab3-426f-9a65-d70dd8287d0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:43.337596 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f1216b7d-bac5-40ad-8b50-63e12c9cf7e0 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:43.338451 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-33b9f15a-3ab3-426f-9a65-d70dd8287d0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:43.338909 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-33b9f15a-3ab3-426f-9a65-d70dd8287d0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:43.613058 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f1216b7d-bac5-40ad-8b50-63e12c9cf7e0 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "POST /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/action" status: 202 len: 0 microversion: 2.1 time: 0.289076 May 26 17:03:43.613855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 347/668] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:03:43 2022] POST /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:03:43.622004 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1810e665-f078-40aa-bdda-51068a1bfa00 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:43.622724 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1810e665-f078-40aa-bdda-51068a1bfa00 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:43.630365 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1810e665-f078-40aa-bdda-51068a1bfa00 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:43.630623 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1810e665-f078-40aa-bdda-51068a1bfa00 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:43.631390 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1810e665-f078-40aa-bdda-51068a1bfa00 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:43.631819 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1810e665-f078-40aa-bdda-51068a1bfa00 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:43.790287 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1810e665-f078-40aa-bdda-51068a1bfa00 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:43.798248 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1810e665-f078-40aa-bdda-51068a1bfa00 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1753 microversion: 2.1 time: 0.180221 May 26 17:03:43.800072 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 348/669] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:43 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:03:44.368625 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-33b9f15a-3ab3-426f-9a65-d70dd8287d0f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "POST /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.044563 May 26 17:03:44.374143 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 322/670] 10.222.0.112 () {62 vars in 1368 bytes} [Thu May 26 17:03:43 2022] POST /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments => generated 188 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:03:44.503267 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d7e8be9c-599a-4631-b33a-cf109836db6f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:44.504191 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d7e8be9c-599a-4631-b33a-cf109836db6f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:44.512175 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d7e8be9c-599a-4631-b33a-cf109836db6f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:44.512623 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d7e8be9c-599a-4631-b33a-cf109836db6f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:44.513400 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d7e8be9c-599a-4631-b33a-cf109836db6f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:44.513834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d7e8be9c-599a-4631-b33a-cf109836db6f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:44.759466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d7e8be9c-599a-4631-b33a-cf109836db6f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "POST /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/action" status: 202 len: 0 microversion: 2.20 time: 0.262991 May 26 17:03:44.760075 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 349/671] 10.222.0.112 () {62 vars in 1323 bytes} [Thu May 26 17:03:44 2022] POST /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 17:03:44.769823 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2c49062f-9bd2-4add-accf-6e25a6ba0b4d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:44.770715 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-2c49062f-9bd2-4add-accf-6e25a6ba0b4d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:44.778021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2c49062f-9bd2-4add-accf-6e25a6ba0b4d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:44.778509 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2c49062f-9bd2-4add-accf-6e25a6ba0b4d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:44.779286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2c49062f-9bd2-4add-accf-6e25a6ba0b4d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:44.779886 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2c49062f-9bd2-4add-accf-6e25a6ba0b4d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:44.818500 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8c006e53-3224-4dd8-a32e-84bf238d995f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:44.819049 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8c006e53-3224-4dd8-a32e-84bf238d995f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:44.825285 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8c006e53-3224-4dd8-a32e-84bf238d995f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:44.832458 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8c006e53-3224-4dd8-a32e-84bf238d995f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:44.832458 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8c006e53-3224-4dd8-a32e-84bf238d995f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:44.832458 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8c006e53-3224-4dd8-a32e-84bf238d995f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:44.926090 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2c49062f-9bd2-4add-accf-6e25a6ba0b4d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:44.928796 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:44.937421 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2c49062f-9bd2-4add-accf-6e25a6ba0b4d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:44.943183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2c49062f-9bd2-4add-accf-6e25a6ba0b4d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:44.943183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-2c49062f-9bd2-4add-accf-6e25a6ba0b4d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1754 microversion: 2.20 time: 0.177303 May 26 17:03:44.943183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 323/672] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:44 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:45.011795 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8c006e53-3224-4dd8-a32e-84bf238d995f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:45.020088 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8c006e53-3224-4dd8-a32e-84bf238d995f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1753 microversion: 2.1 time: 0.206713 May 26 17:03:45.020671 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 350/673] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:44 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1753 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:03:45.961305 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b0b168b6-be85-4a67-a80a-f119c4a41b1c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:45.961973 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b0b168b6-be85-4a67-a80a-f119c4a41b1c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:45.968689 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b0b168b6-be85-4a67-a80a-f119c4a41b1c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:45.969143 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b0b168b6-be85-4a67-a80a-f119c4a41b1c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:45.969906 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b0b168b6-be85-4a67-a80a-f119c4a41b1c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:45.971021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b0b168b6-be85-4a67-a80a-f119c4a41b1c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:46.037168 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-713e6dd7-5ff6-4262-8241-6a1e45a8fb66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:46.038858 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-713e6dd7-5ff6-4262-8241-6a1e45a8fb66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:46.045814 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-713e6dd7-5ff6-4262-8241-6a1e45a8fb66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:46.046560 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-713e6dd7-5ff6-4262-8241-6a1e45a8fb66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:46.049938 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-713e6dd7-5ff6-4262-8241-6a1e45a8fb66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:46.049938 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-713e6dd7-5ff6-4262-8241-6a1e45a8fb66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:46.105469 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b0b168b6-be85-4a67-a80a-f119c4a41b1c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:46.114428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b0b168b6-be85-4a67-a80a-f119c4a41b1c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:46.115924 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b0b168b6-be85-4a67-a80a-f119c4a41b1c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:46.117078 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b0b168b6-be85-4a67-a80a-f119c4a41b1c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1754 microversion: 2.20 time: 0.160313 May 26 17:03:46.117634 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 324/674] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:45 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:46.203022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-713e6dd7-5ff6-4262-8241-6a1e45a8fb66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:46.211974 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-713e6dd7-5ff6-4262-8241-6a1e45a8fb66 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.178783 May 26 17:03:46.212760 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 351/675] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:46 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:03:47.137074 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b9734d15-e7f1-4972-9450-b8f3ed5e195a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:47.137593 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b9734d15-e7f1-4972-9450-b8f3ed5e195a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:47.144625 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b9734d15-e7f1-4972-9450-b8f3ed5e195a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:47.145060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b9734d15-e7f1-4972-9450-b8f3ed5e195a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:47.145810 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b9734d15-e7f1-4972-9450-b8f3ed5e195a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:47.146233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b9734d15-e7f1-4972-9450-b8f3ed5e195a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:47.228852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dc7b5473-f622-4831-9cfd-8c4628314037 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:47.229460 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-dc7b5473-f622-4831-9cfd-8c4628314037 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:47.237078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dc7b5473-f622-4831-9cfd-8c4628314037 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:47.237295 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dc7b5473-f622-4831-9cfd-8c4628314037 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:47.237964 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dc7b5473-f622-4831-9cfd-8c4628314037 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:47.238426 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dc7b5473-f622-4831-9cfd-8c4628314037 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:47.277694 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b9734d15-e7f1-4972-9450-b8f3ed5e195a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:47.286475 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b9734d15-e7f1-4972-9450-b8f3ed5e195a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:47.288006 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b9734d15-e7f1-4972-9450-b8f3ed5e195a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:47.289175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b9734d15-e7f1-4972-9450-b8f3ed5e195a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1756 microversion: 2.20 time: 0.156147 May 26 17:03:47.289778 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 325/676] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:47 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:47.585256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dc7b5473-f622-4831-9cfd-8c4628314037 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:47.593422 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-dc7b5473-f622-4831-9cfd-8c4628314037 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.368391 May 26 17:03:47.594004 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 352/677] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:47 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:03:48.308749 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4e9d1cec-c792-4134-8f89-7454355f8d7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:48.309374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4e9d1cec-c792-4134-8f89-7454355f8d7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:48.316996 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e9d1cec-c792-4134-8f89-7454355f8d7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:48.317444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e9d1cec-c792-4134-8f89-7454355f8d7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:48.318203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e9d1cec-c792-4134-8f89-7454355f8d7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:48.318672 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e9d1cec-c792-4134-8f89-7454355f8d7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:48.451801 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4e9d1cec-c792-4134-8f89-7454355f8d7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:48.461035 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4e9d1cec-c792-4134-8f89-7454355f8d7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:48.462579 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4e9d1cec-c792-4134-8f89-7454355f8d7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:48.467075 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4e9d1cec-c792-4134-8f89-7454355f8d7e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1756 microversion: 2.20 time: 0.159053 May 26 17:03:48.467075 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 326/678] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:48 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:48.610634 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-29ae2818-dc82-40d5-8b06-04b422967759 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:48.611847 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-29ae2818-dc82-40d5-8b06-04b422967759 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:48.618262 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-29ae2818-dc82-40d5-8b06-04b422967759 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:48.618743 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-29ae2818-dc82-40d5-8b06-04b422967759 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:48.627529 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-29ae2818-dc82-40d5-8b06-04b422967759 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:48.627529 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-29ae2818-dc82-40d5-8b06-04b422967759 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:48.759801 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-29ae2818-dc82-40d5-8b06-04b422967759 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:48.768389 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-29ae2818-dc82-40d5-8b06-04b422967759 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.161659 May 26 17:03:48.768964 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 353/679] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:48 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:49.481830 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-636c18e6-3f86-4b18-96be-0085b67e310d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:49.482375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-636c18e6-3f86-4b18-96be-0085b67e310d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:49.489105 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-636c18e6-3f86-4b18-96be-0085b67e310d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:49.489547 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-636c18e6-3f86-4b18-96be-0085b67e310d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:49.490298 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-636c18e6-3f86-4b18-96be-0085b67e310d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:49.490755 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-636c18e6-3f86-4b18-96be-0085b67e310d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:49.624587 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-636c18e6-3f86-4b18-96be-0085b67e310d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:49.633682 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-636c18e6-3f86-4b18-96be-0085b67e310d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:49.635246 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-636c18e6-3f86-4b18-96be-0085b67e310d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:49.636406 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-636c18e6-3f86-4b18-96be-0085b67e310d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.158524 May 26 17:03:49.636986 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 327/680] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:49 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:49.786015 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-54c34b4f-bdcb-44cf-b211-d7836b207320 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:49.786576 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-54c34b4f-bdcb-44cf-b211-d7836b207320 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:49.793157 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54c34b4f-bdcb-44cf-b211-d7836b207320 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:49.793604 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54c34b4f-bdcb-44cf-b211-d7836b207320 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:49.794390 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54c34b4f-bdcb-44cf-b211-d7836b207320 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:49.794830 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54c34b4f-bdcb-44cf-b211-d7836b207320 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:49.940353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-54c34b4f-bdcb-44cf-b211-d7836b207320 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:49.948242 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-54c34b4f-bdcb-44cf-b211-d7836b207320 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.166769 May 26 17:03:49.948808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 354/681] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:49 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:50.655971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-68d443ba-758b-42e6-9595-4aae45e599d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:50.656580 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-68d443ba-758b-42e6-9595-4aae45e599d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:50.663187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-68d443ba-758b-42e6-9595-4aae45e599d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:50.664247 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-68d443ba-758b-42e6-9595-4aae45e599d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:50.665030 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-68d443ba-758b-42e6-9595-4aae45e599d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:50.665467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-68d443ba-758b-42e6-9595-4aae45e599d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:50.800040 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-68d443ba-758b-42e6-9595-4aae45e599d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:50.808524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-68d443ba-758b-42e6-9595-4aae45e599d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:50.810026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-68d443ba-758b-42e6-9595-4aae45e599d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:50.811238 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-68d443ba-758b-42e6-9595-4aae45e599d4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.159216 May 26 17:03:50.812002 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 328/682] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:50 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:50.966843 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6e244d32-a198-4577-9647-e97b72a9cabc tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:50.967455 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6e244d32-a198-4577-9647-e97b72a9cabc tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:50.974573 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6e244d32-a198-4577-9647-e97b72a9cabc tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:50.975027 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6e244d32-a198-4577-9647-e97b72a9cabc tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:50.975802 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6e244d32-a198-4577-9647-e97b72a9cabc tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:50.976237 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6e244d32-a198-4577-9647-e97b72a9cabc tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:51.120785 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6e244d32-a198-4577-9647-e97b72a9cabc tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:51.129667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6e244d32-a198-4577-9647-e97b72a9cabc tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.166681 May 26 17:03:51.130358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 355/683] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:50 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:51.832042 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-97806837-1e0f-44d0-8f37-e487499f1487 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:51.832622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-97806837-1e0f-44d0-8f37-e487499f1487 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:51.839072 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-97806837-1e0f-44d0-8f37-e487499f1487 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:51.839513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-97806837-1e0f-44d0-8f37-e487499f1487 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:51.840259 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-97806837-1e0f-44d0-8f37-e487499f1487 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:51.840684 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-97806837-1e0f-44d0-8f37-e487499f1487 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:51.979396 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-97806837-1e0f-44d0-8f37-e487499f1487 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:51.987736 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-97806837-1e0f-44d0-8f37-e487499f1487 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:51.989217 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-97806837-1e0f-44d0-8f37-e487499f1487 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:51.990410 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-97806837-1e0f-44d0-8f37-e487499f1487 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.163077 May 26 17:03:51.990973 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 329/684] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:51 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:52.147441 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7543be41-50b7-4c96-bdb2-8d380eba4ed5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:52.148104 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7543be41-50b7-4c96-bdb2-8d380eba4ed5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:52.154992 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7543be41-50b7-4c96-bdb2-8d380eba4ed5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:52.155441 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7543be41-50b7-4c96-bdb2-8d380eba4ed5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:52.156213 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7543be41-50b7-4c96-bdb2-8d380eba4ed5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:52.156649 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7543be41-50b7-4c96-bdb2-8d380eba4ed5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:52.313074 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7543be41-50b7-4c96-bdb2-8d380eba4ed5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:52.322145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7543be41-50b7-4c96-bdb2-8d380eba4ed5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.178670 May 26 17:03:52.322762 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 356/685] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:52 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:53.008738 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-31a00195-b397-48d7-8cb4-7fd51705aa8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:53.009336 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-31a00195-b397-48d7-8cb4-7fd51705aa8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:53.016216 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-31a00195-b397-48d7-8cb4-7fd51705aa8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:53.016664 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-31a00195-b397-48d7-8cb4-7fd51705aa8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:53.017982 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-31a00195-b397-48d7-8cb4-7fd51705aa8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:53.018452 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-31a00195-b397-48d7-8cb4-7fd51705aa8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:53.168803 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-31a00195-b397-48d7-8cb4-7fd51705aa8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:53.178011 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-31a00195-b397-48d7-8cb4-7fd51705aa8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:53.179555 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-31a00195-b397-48d7-8cb4-7fd51705aa8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:53.180724 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-31a00195-b397-48d7-8cb4-7fd51705aa8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.175999 May 26 17:03:53.181301 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 330/686] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:53 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:53.340983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b78189d8-6163-490d-8975-24975b7f3415 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:53.341537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b78189d8-6163-490d-8975-24975b7f3415 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:53.348528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b78189d8-6163-490d-8975-24975b7f3415 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:53.348988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b78189d8-6163-490d-8975-24975b7f3415 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:53.349762 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b78189d8-6163-490d-8975-24975b7f3415 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:53.350203 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b78189d8-6163-490d-8975-24975b7f3415 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:53.504119 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b78189d8-6163-490d-8975-24975b7f3415 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:53.512224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b78189d8-6163-490d-8975-24975b7f3415 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.175179 May 26 17:03:53.512795 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 357/687] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:53 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:54.200366 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5b2b68f4-eb0f-412a-a377-1806cf4b0bdd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:54.201464 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5b2b68f4-eb0f-412a-a377-1806cf4b0bdd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:54.208657 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5b2b68f4-eb0f-412a-a377-1806cf4b0bdd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:54.209216 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5b2b68f4-eb0f-412a-a377-1806cf4b0bdd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:54.209947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5b2b68f4-eb0f-412a-a377-1806cf4b0bdd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:54.210607 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5b2b68f4-eb0f-412a-a377-1806cf4b0bdd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:54.369180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5b2b68f4-eb0f-412a-a377-1806cf4b0bdd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:54.386033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5b2b68f4-eb0f-412a-a377-1806cf4b0bdd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:54.387574 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5b2b68f4-eb0f-412a-a377-1806cf4b0bdd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:54.388769 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5b2b68f4-eb0f-412a-a377-1806cf4b0bdd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.192364 May 26 17:03:54.389335 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 331/688] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:54 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:03:54.529536 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-815da42e-721e-4ea6-958d-353bd9820015 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:54.530782 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-815da42e-721e-4ea6-958d-353bd9820015 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:54.537913 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-815da42e-721e-4ea6-958d-353bd9820015 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:54.538378 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-815da42e-721e-4ea6-958d-353bd9820015 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:54.539150 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-815da42e-721e-4ea6-958d-353bd9820015 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:54.539577 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-815da42e-721e-4ea6-958d-353bd9820015 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:54.726234 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-815da42e-721e-4ea6-958d-353bd9820015 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:54.740706 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-815da42e-721e-4ea6-958d-353bd9820015 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.215121 May 26 17:03:54.741306 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 358/689] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:54 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:55.411776 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a3d3ccbd-07f5-4900-8418-0ceac92330c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:55.412967 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a3d3ccbd-07f5-4900-8418-0ceac92330c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:55.419682 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a3d3ccbd-07f5-4900-8418-0ceac92330c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:55.420125 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a3d3ccbd-07f5-4900-8418-0ceac92330c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:55.420894 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a3d3ccbd-07f5-4900-8418-0ceac92330c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:55.421321 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a3d3ccbd-07f5-4900-8418-0ceac92330c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:55.571980 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a3d3ccbd-07f5-4900-8418-0ceac92330c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:55.578351 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a3d3ccbd-07f5-4900-8418-0ceac92330c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:55.580395 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a3d3ccbd-07f5-4900-8418-0ceac92330c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:55.581841 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a3d3ccbd-07f5-4900-8418-0ceac92330c3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.173958 May 26 17:03:55.582458 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 332/690] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:55 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:55.764198 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f75b46a2-ccc0-411b-9c8d-819fe46404d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:55.764198 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f75b46a2-ccc0-411b-9c8d-819fe46404d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:55.765681 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f75b46a2-ccc0-411b-9c8d-819fe46404d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:55.766119 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f75b46a2-ccc0-411b-9c8d-819fe46404d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:55.767574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f75b46a2-ccc0-411b-9c8d-819fe46404d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:55.768133 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f75b46a2-ccc0-411b-9c8d-819fe46404d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:55.782989 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:55.935559 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f75b46a2-ccc0-411b-9c8d-819fe46404d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:55.944086 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f75b46a2-ccc0-411b-9c8d-819fe46404d9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.189031 May 26 17:03:55.944667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 359/691] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:55 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:03:56.600685 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e9130bb2-f261-4176-ba9d-0eeebf1532ec tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:56.601481 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e9130bb2-f261-4176-ba9d-0eeebf1532ec tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:56.603690 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=38 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:56.608769 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9130bb2-f261-4176-ba9d-0eeebf1532ec tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:56.609223 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9130bb2-f261-4176-ba9d-0eeebf1532ec tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:56.610039 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9130bb2-f261-4176-ba9d-0eeebf1532ec tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:56.610479 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9130bb2-f261-4176-ba9d-0eeebf1532ec tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:56.753483 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e9130bb2-f261-4176-ba9d-0eeebf1532ec tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:56.762762 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e9130bb2-f261-4176-ba9d-0eeebf1532ec tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:56.766202 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e9130bb2-f261-4176-ba9d-0eeebf1532ec tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:56.766202 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e9130bb2-f261-4176-ba9d-0eeebf1532ec tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.168722 May 26 17:03:56.766570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 333/692] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:56 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:56.961979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-cbdeaf87-70f1-4249-bd23-3781d12fdbe4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:56.962773 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-cbdeaf87-70f1-4249-bd23-3781d12fdbe4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:56.969792 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cbdeaf87-70f1-4249-bd23-3781d12fdbe4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:56.972973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cbdeaf87-70f1-4249-bd23-3781d12fdbe4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:56.972973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cbdeaf87-70f1-4249-bd23-3781d12fdbe4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:56.972973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cbdeaf87-70f1-4249-bd23-3781d12fdbe4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:57.130808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cbdeaf87-70f1-4249-bd23-3781d12fdbe4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:57.139765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-cbdeaf87-70f1-4249-bd23-3781d12fdbe4 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.182085 May 26 17:03:57.140357 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 360/693] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:56 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:57.785608 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1754050d-dd61-4aef-b8df-f7c80fa3a918 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:57.786188 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1754050d-dd61-4aef-b8df-f7c80fa3a918 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:57.792826 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1754050d-dd61-4aef-b8df-f7c80fa3a918 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:57.793297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1754050d-dd61-4aef-b8df-f7c80fa3a918 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:57.794099 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1754050d-dd61-4aef-b8df-f7c80fa3a918 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:57.794574 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1754050d-dd61-4aef-b8df-f7c80fa3a918 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:57.949271 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1754050d-dd61-4aef-b8df-f7c80fa3a918 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:57.959666 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1754050d-dd61-4aef-b8df-f7c80fa3a918 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:57.961301 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1754050d-dd61-4aef-b8df-f7c80fa3a918 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:57.962531 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1754050d-dd61-4aef-b8df-f7c80fa3a918 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.181374 May 26 17:03:57.963098 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 334/694] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:57 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:58.157070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-aaee395c-518a-4d7d-bc1f-f8a27c04e847 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:58.158694 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-aaee395c-518a-4d7d-bc1f-f8a27c04e847 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:58.161230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=48 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:58.166079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aaee395c-518a-4d7d-bc1f-f8a27c04e847 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:58.170784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aaee395c-518a-4d7d-bc1f-f8a27c04e847 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:58.170784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aaee395c-518a-4d7d-bc1f-f8a27c04e847 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:58.170784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aaee395c-518a-4d7d-bc1f-f8a27c04e847 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:58.331005 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-aaee395c-518a-4d7d-bc1f-f8a27c04e847 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:58.340260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-aaee395c-518a-4d7d-bc1f-f8a27c04e847 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.187003 May 26 17:03:58.346314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 361/695] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:58 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:58.982389 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-56fe025b-7260-412e-bb21-bc6041cb1c03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:58.983070 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-56fe025b-7260-412e-bb21-bc6041cb1c03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:58.989995 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-56fe025b-7260-412e-bb21-bc6041cb1c03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:58.990474 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-56fe025b-7260-412e-bb21-bc6041cb1c03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:58.991239 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-56fe025b-7260-412e-bb21-bc6041cb1c03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:58.991665 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-56fe025b-7260-412e-bb21-bc6041cb1c03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:59.133189 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-56fe025b-7260-412e-bb21-bc6041cb1c03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:59.145333 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-56fe025b-7260-412e-bb21-bc6041cb1c03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:59.146956 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-56fe025b-7260-412e-bb21-bc6041cb1c03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:59.148272 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-56fe025b-7260-412e-bb21-bc6041cb1c03 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.169792 May 26 17:03:59.148999 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 335/696] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:03:58 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:03:59.358851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-98539936-81d9-4de8-a880-06ab611d76c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:59.359441 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-98539936-81d9-4de8-a880-06ab611d76c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:59.366833 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-98539936-81d9-4de8-a880-06ab611d76c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:59.367286 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-98539936-81d9-4de8-a880-06ab611d76c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:59.368061 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-98539936-81d9-4de8-a880-06ab611d76c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:59.368511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-98539936-81d9-4de8-a880-06ab611d76c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:59.539944 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-98539936-81d9-4de8-a880-06ab611d76c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:59.560606 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-98539936-81d9-4de8-a880-06ab611d76c6 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.205628 May 26 17:03:59.561406 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 362/697] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:03:59 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:00.167155 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cfd0cb13-7c8c-4188-ac88-412c1f14b68e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:00.167974 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cfd0cb13-7c8c-4188-ac88-412c1f14b68e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:00.175327 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfd0cb13-7c8c-4188-ac88-412c1f14b68e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:00.175717 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfd0cb13-7c8c-4188-ac88-412c1f14b68e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:00.176382 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfd0cb13-7c8c-4188-ac88-412c1f14b68e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:00.176819 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfd0cb13-7c8c-4188-ac88-412c1f14b68e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:00.319682 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cfd0cb13-7c8c-4188-ac88-412c1f14b68e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:00.328441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cfd0cb13-7c8c-4188-ac88-412c1f14b68e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:00.330638 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cfd0cb13-7c8c-4188-ac88-412c1f14b68e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:00.332144 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cfd0cb13-7c8c-4188-ac88-412c1f14b68e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.168864 May 26 17:04:00.332748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 336/698] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:00 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:00.578436 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7205375b-3db1-45fb-b4c2-146210a71e1a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:00.579819 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7205375b-3db1-45fb-b4c2-146210a71e1a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:00.586915 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7205375b-3db1-45fb-b4c2-146210a71e1a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:00.587424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7205375b-3db1-45fb-b4c2-146210a71e1a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:00.588222 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7205375b-3db1-45fb-b4c2-146210a71e1a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:00.588727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7205375b-3db1-45fb-b4c2-146210a71e1a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:00.755441 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7205375b-3db1-45fb-b4c2-146210a71e1a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:00.768364 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7205375b-3db1-45fb-b4c2-146210a71e1a tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.193800 May 26 17:04:00.768942 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 363/699] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:00 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:01.353140 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ead1b50d-481e-49d3-92dd-151fb21bb901 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:01.353707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ead1b50d-481e-49d3-92dd-151fb21bb901 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:01.360960 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ead1b50d-481e-49d3-92dd-151fb21bb901 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:01.361413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ead1b50d-481e-49d3-92dd-151fb21bb901 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:01.362197 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ead1b50d-481e-49d3-92dd-151fb21bb901 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:01.363082 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ead1b50d-481e-49d3-92dd-151fb21bb901 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:01.520461 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ead1b50d-481e-49d3-92dd-151fb21bb901 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:01.534968 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ead1b50d-481e-49d3-92dd-151fb21bb901 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:01.536965 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ead1b50d-481e-49d3-92dd-151fb21bb901 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:01.538209 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ead1b50d-481e-49d3-92dd-151fb21bb901 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.189195 May 26 17:04:01.538868 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 337/700] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:01 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:04:01.785452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2b9762c7-9421-452f-9b31-7e5811182590 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:01.786175 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2b9762c7-9421-452f-9b31-7e5811182590 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:01.792902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b9762c7-9421-452f-9b31-7e5811182590 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:01.793375 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b9762c7-9421-452f-9b31-7e5811182590 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:01.794147 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b9762c7-9421-452f-9b31-7e5811182590 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:01.794619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b9762c7-9421-452f-9b31-7e5811182590 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:01.971099 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2b9762c7-9421-452f-9b31-7e5811182590 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:01.979530 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2b9762c7-9421-452f-9b31-7e5811182590 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.198050 May 26 17:04:01.980133 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 364/701] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:01 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:02.564894 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fa53a584-429e-454a-986a-0cd54c9396f2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:02.565995 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fa53a584-429e-454a-986a-0cd54c9396f2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:02.576814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa53a584-429e-454a-986a-0cd54c9396f2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:02.577679 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa53a584-429e-454a-986a-0cd54c9396f2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:02.580226 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa53a584-429e-454a-986a-0cd54c9396f2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:02.584106 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa53a584-429e-454a-986a-0cd54c9396f2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:02.734183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fa53a584-429e-454a-986a-0cd54c9396f2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:02.743801 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fa53a584-429e-454a-986a-0cd54c9396f2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:02.745314 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fa53a584-429e-454a-986a-0cd54c9396f2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:02.746559 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fa53a584-429e-454a-986a-0cd54c9396f2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.190580 May 26 17:04:02.747146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 338/702] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:02 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:04:03.004593 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-113108d9-0ff7-4c3f-9d9c-130cb0387932 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:03.006016 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-113108d9-0ff7-4c3f-9d9c-130cb0387932 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:03.012774 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-113108d9-0ff7-4c3f-9d9c-130cb0387932 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:03.013228 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-113108d9-0ff7-4c3f-9d9c-130cb0387932 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:03.014009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-113108d9-0ff7-4c3f-9d9c-130cb0387932 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:03.014479 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-113108d9-0ff7-4c3f-9d9c-130cb0387932 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:03.183813 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-113108d9-0ff7-4c3f-9d9c-130cb0387932 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:03.192582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-113108d9-0ff7-4c3f-9d9c-130cb0387932 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.192937 May 26 17:04:03.193161 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 365/703] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:02 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:03.766743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-75d3a867-29d3-4e70-8bb2-3b8d7da124f3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:03.767442 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-75d3a867-29d3-4e70-8bb2-3b8d7da124f3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:03.774054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75d3a867-29d3-4e70-8bb2-3b8d7da124f3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:03.774546 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75d3a867-29d3-4e70-8bb2-3b8d7da124f3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:03.775314 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75d3a867-29d3-4e70-8bb2-3b8d7da124f3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:03.775742 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75d3a867-29d3-4e70-8bb2-3b8d7da124f3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:03.927699 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-75d3a867-29d3-4e70-8bb2-3b8d7da124f3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:03.936503 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-75d3a867-29d3-4e70-8bb2-3b8d7da124f3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:03.938097 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-75d3a867-29d3-4e70-8bb2-3b8d7da124f3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:03.939298 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-75d3a867-29d3-4e70-8bb2-3b8d7da124f3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.176976 May 26 17:04:03.939858 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 339/704] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:03 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:04.211630 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a6348e83-3d1f-4c87-9e90-531631e9a5af tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:04.212232 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a6348e83-3d1f-4c87-9e90-531631e9a5af tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:04.218760 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a6348e83-3d1f-4c87-9e90-531631e9a5af tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:04.219207 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a6348e83-3d1f-4c87-9e90-531631e9a5af tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:04.220119 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a6348e83-3d1f-4c87-9e90-531631e9a5af tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:04.220557 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a6348e83-3d1f-4c87-9e90-531631e9a5af tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:04.380606 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a6348e83-3d1f-4c87-9e90-531631e9a5af tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:04.388678 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a6348e83-3d1f-4c87-9e90-531631e9a5af tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.182050 May 26 17:04:04.389264 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 366/705] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:04 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:04.959233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-91ca0386-7209-4dd0-a52e-73b359322077 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:04.959907 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-91ca0386-7209-4dd0-a52e-73b359322077 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:04.966950 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91ca0386-7209-4dd0-a52e-73b359322077 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:04.967410 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91ca0386-7209-4dd0-a52e-73b359322077 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:04.968196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91ca0386-7209-4dd0-a52e-73b359322077 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:04.968831 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91ca0386-7209-4dd0-a52e-73b359322077 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:04.987767 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:05.121922 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-91ca0386-7209-4dd0-a52e-73b359322077 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:05.131666 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-91ca0386-7209-4dd0-a52e-73b359322077 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:05.133193 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-91ca0386-7209-4dd0-a52e-73b359322077 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:05.134601 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-91ca0386-7209-4dd0-a52e-73b359322077 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.179395 May 26 17:04:05.135606 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 340/706] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:04 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:05.406849 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4aa58c13-6df4-41e7-83bc-e28fc44f03e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:05.407485 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4aa58c13-6df4-41e7-83bc-e28fc44f03e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:05.413990 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4aa58c13-6df4-41e7-83bc-e28fc44f03e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:05.414489 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4aa58c13-6df4-41e7-83bc-e28fc44f03e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:05.415263 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4aa58c13-6df4-41e7-83bc-e28fc44f03e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:05.415699 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4aa58c13-6df4-41e7-83bc-e28fc44f03e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:05.572938 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4aa58c13-6df4-41e7-83bc-e28fc44f03e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:05.581858 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4aa58c13-6df4-41e7-83bc-e28fc44f03e8 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.178611 May 26 17:04:05.582455 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 367/707] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:05 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:06.155020 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-bae1f6dc-fafd-4434-92cf-cddba4ed2964 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:06.156480 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-bae1f6dc-fafd-4434-92cf-cddba4ed2964 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:06.164817 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bae1f6dc-fafd-4434-92cf-cddba4ed2964 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:06.165374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bae1f6dc-fafd-4434-92cf-cddba4ed2964 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:06.166254 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bae1f6dc-fafd-4434-92cf-cddba4ed2964 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:06.166777 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bae1f6dc-fafd-4434-92cf-cddba4ed2964 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:06.315135 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bae1f6dc-fafd-4434-92cf-cddba4ed2964 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:06.324288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bae1f6dc-fafd-4434-92cf-cddba4ed2964 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:06.325876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bae1f6dc-fafd-4434-92cf-cddba4ed2964 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:06.327101 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-bae1f6dc-fafd-4434-92cf-cddba4ed2964 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.176326 May 26 17:04:06.327935 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 341/708] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:06 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:06.599904 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a985996f-6aa7-4330-b2cd-a7130397c034 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:06.600583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a985996f-6aa7-4330-b2cd-a7130397c034 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:06.607232 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a985996f-6aa7-4330-b2cd-a7130397c034 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:06.607680 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a985996f-6aa7-4330-b2cd-a7130397c034 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:06.608440 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a985996f-6aa7-4330-b2cd-a7130397c034 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:06.608874 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a985996f-6aa7-4330-b2cd-a7130397c034 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:06.772128 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a985996f-6aa7-4330-b2cd-a7130397c034 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:06.780372 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a985996f-6aa7-4330-b2cd-a7130397c034 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.184241 May 26 17:04:06.780895 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 368/709] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:06 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:07.346070 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1fd1f5c8-1985-48b8-8598-e3b851291f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:07.346732 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1fd1f5c8-1985-48b8-8598-e3b851291f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:07.353597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1fd1f5c8-1985-48b8-8598-e3b851291f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:07.354044 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1fd1f5c8-1985-48b8-8598-e3b851291f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:07.354871 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1fd1f5c8-1985-48b8-8598-e3b851291f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:07.355301 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1fd1f5c8-1985-48b8-8598-e3b851291f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:07.502936 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1fd1f5c8-1985-48b8-8598-e3b851291f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:07.511275 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1fd1f5c8-1985-48b8-8598-e3b851291f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:07.514245 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1fd1f5c8-1985-48b8-8598-e3b851291f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:07.516126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1fd1f5c8-1985-48b8-8598-e3b851291f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.173856 May 26 17:04:07.516911 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 342/710] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:07 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:07.799000 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-39bc10ce-d4f3-4916-af70-dd7a7c477c8b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:07.799599 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-39bc10ce-d4f3-4916-af70-dd7a7c477c8b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:07.806280 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-39bc10ce-d4f3-4916-af70-dd7a7c477c8b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:07.806767 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-39bc10ce-d4f3-4916-af70-dd7a7c477c8b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:07.807548 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-39bc10ce-d4f3-4916-af70-dd7a7c477c8b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:07.807988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-39bc10ce-d4f3-4916-af70-dd7a7c477c8b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:07.959686 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-39bc10ce-d4f3-4916-af70-dd7a7c477c8b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:07.967720 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-39bc10ce-d4f3-4916-af70-dd7a7c477c8b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.173517 May 26 17:04:07.968295 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 369/711] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:07 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:08.536097 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-da9e31e5-ef5e-46bc-a9a1-8b98dddcf6a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:08.536780 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-da9e31e5-ef5e-46bc-a9a1-8b98dddcf6a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:08.544046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-da9e31e5-ef5e-46bc-a9a1-8b98dddcf6a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:08.544581 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-da9e31e5-ef5e-46bc-a9a1-8b98dddcf6a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:08.545442 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-da9e31e5-ef5e-46bc-a9a1-8b98dddcf6a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:08.545936 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-da9e31e5-ef5e-46bc-a9a1-8b98dddcf6a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:08.689054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-da9e31e5-ef5e-46bc-a9a1-8b98dddcf6a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:08.697995 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-da9e31e5-ef5e-46bc-a9a1-8b98dddcf6a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:08.699548 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-da9e31e5-ef5e-46bc-a9a1-8b98dddcf6a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:08.700732 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-da9e31e5-ef5e-46bc-a9a1-8b98dddcf6a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.169229 May 26 17:04:08.701297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 343/712] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:08 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:08.985690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-18df0409-e7bc-463e-b451-69513c017b06 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:08.986411 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-18df0409-e7bc-463e-b451-69513c017b06 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:08.992910 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-18df0409-e7bc-463e-b451-69513c017b06 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:08.993352 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-18df0409-e7bc-463e-b451-69513c017b06 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:08.994158 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-18df0409-e7bc-463e-b451-69513c017b06 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:08.994632 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-18df0409-e7bc-463e-b451-69513c017b06 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:09.157858 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-18df0409-e7bc-463e-b451-69513c017b06 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:09.166185 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-18df0409-e7bc-463e-b451-69513c017b06 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.185016 May 26 17:04:09.166795 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 370/713] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:08 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:09.720370 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-de823890-dc8b-47d5-9db0-ea083c80d8f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:09.721088 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-de823890-dc8b-47d5-9db0-ea083c80d8f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:09.727667 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de823890-dc8b-47d5-9db0-ea083c80d8f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:09.728114 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de823890-dc8b-47d5-9db0-ea083c80d8f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:09.728885 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de823890-dc8b-47d5-9db0-ea083c80d8f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:09.729320 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de823890-dc8b-47d5-9db0-ea083c80d8f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:09.872655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-de823890-dc8b-47d5-9db0-ea083c80d8f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:09.881935 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-de823890-dc8b-47d5-9db0-ea083c80d8f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:09.885054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-de823890-dc8b-47d5-9db0-ea083c80d8f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:09.885054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-de823890-dc8b-47d5-9db0-ea083c80d8f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.168386 May 26 17:04:09.885333 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 344/714] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:09 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:10.184678 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5b9a14f6-dedf-45d9-b18a-eb3a333c6829 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:10.185285 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5b9a14f6-dedf-45d9-b18a-eb3a333c6829 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:10.192507 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b9a14f6-dedf-45d9-b18a-eb3a333c6829 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:10.192950 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b9a14f6-dedf-45d9-b18a-eb3a333c6829 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:10.193709 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b9a14f6-dedf-45d9-b18a-eb3a333c6829 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:10.194136 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b9a14f6-dedf-45d9-b18a-eb3a333c6829 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:10.339238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5b9a14f6-dedf-45d9-b18a-eb3a333c6829 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:10.348155 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5b9a14f6-dedf-45d9-b18a-eb3a333c6829 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.167308 May 26 17:04:10.348743 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 371/715] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:10 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:10.904178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-84bc7229-015f-4c80-aba1-50fd59b4b0f9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:10.904785 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-84bc7229-015f-4c80-aba1-50fd59b4b0f9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:10.912110 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-84bc7229-015f-4c80-aba1-50fd59b4b0f9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:10.912557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-84bc7229-015f-4c80-aba1-50fd59b4b0f9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:10.913331 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-84bc7229-015f-4c80-aba1-50fd59b4b0f9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:10.913791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-84bc7229-015f-4c80-aba1-50fd59b4b0f9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:11.054841 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-84bc7229-015f-4c80-aba1-50fd59b4b0f9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:11.063397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-84bc7229-015f-4c80-aba1-50fd59b4b0f9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:11.064991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-84bc7229-015f-4c80-aba1-50fd59b4b0f9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:11.066146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-84bc7229-015f-4c80-aba1-50fd59b4b0f9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.165875 May 26 17:04:11.066751 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 345/716] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:10 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:11.365047 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e546b85b-df25-4e21-b4ff-339d7c6ea517 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:11.365655 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e546b85b-df25-4e21-b4ff-339d7c6ea517 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:11.372228 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e546b85b-df25-4e21-b4ff-339d7c6ea517 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:11.372674 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e546b85b-df25-4e21-b4ff-339d7c6ea517 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:11.373437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e546b85b-df25-4e21-b4ff-339d7c6ea517 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:11.373870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e546b85b-df25-4e21-b4ff-339d7c6ea517 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:11.528858 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e546b85b-df25-4e21-b4ff-339d7c6ea517 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:11.537337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e546b85b-df25-4e21-b4ff-339d7c6ea517 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.176242 May 26 17:04:11.537906 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 372/717] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:11 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:12.085030 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-bad6df2b-3716-4fcb-95ac-490e436f0bb1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:12.085663 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-bad6df2b-3716-4fcb-95ac-490e436f0bb1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:12.092216 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bad6df2b-3716-4fcb-95ac-490e436f0bb1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:12.092662 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bad6df2b-3716-4fcb-95ac-490e436f0bb1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:12.093427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bad6df2b-3716-4fcb-95ac-490e436f0bb1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:12.093863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bad6df2b-3716-4fcb-95ac-490e436f0bb1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:12.229452 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bad6df2b-3716-4fcb-95ac-490e436f0bb1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:12.238363 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bad6df2b-3716-4fcb-95ac-490e436f0bb1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:12.239874 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bad6df2b-3716-4fcb-95ac-490e436f0bb1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:12.241046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-bad6df2b-3716-4fcb-95ac-490e436f0bb1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.160280 May 26 17:04:12.241610 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 346/718] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:12 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:12.554574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3bf19abc-59f2-442e-8d4c-4d0d8d433131 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:12.555216 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3bf19abc-59f2-442e-8d4c-4d0d8d433131 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:12.561795 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3bf19abc-59f2-442e-8d4c-4d0d8d433131 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:12.562246 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3bf19abc-59f2-442e-8d4c-4d0d8d433131 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:12.563575 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3bf19abc-59f2-442e-8d4c-4d0d8d433131 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:12.564004 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3bf19abc-59f2-442e-8d4c-4d0d8d433131 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:12.713335 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3bf19abc-59f2-442e-8d4c-4d0d8d433131 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:12.721404 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3bf19abc-59f2-442e-8d4c-4d0d8d433131 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.170868 May 26 17:04:12.721976 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 373/719] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:12 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:13.260052 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4c76be2b-cf85-462c-93cf-728dc7b46412 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:13.260655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4c76be2b-cf85-462c-93cf-728dc7b46412 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:13.267824 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4c76be2b-cf85-462c-93cf-728dc7b46412 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:13.268268 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4c76be2b-cf85-462c-93cf-728dc7b46412 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:13.269031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4c76be2b-cf85-462c-93cf-728dc7b46412 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:13.269470 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4c76be2b-cf85-462c-93cf-728dc7b46412 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:13.401457 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4c76be2b-cf85-462c-93cf-728dc7b46412 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:13.410643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4c76be2b-cf85-462c-93cf-728dc7b46412 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:13.412079 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4c76be2b-cf85-462c-93cf-728dc7b46412 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:13.413244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4c76be2b-cf85-462c-93cf-728dc7b46412 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.157106 May 26 17:04:13.413819 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 347/720] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:13 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:13.738148 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d31d3262-312d-4132-bcb1-f3b6a4e638e9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:13.738747 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d31d3262-312d-4132-bcb1-f3b6a4e638e9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:13.745231 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d31d3262-312d-4132-bcb1-f3b6a4e638e9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:13.749878 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d31d3262-312d-4132-bcb1-f3b6a4e638e9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:13.749878 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d31d3262-312d-4132-bcb1-f3b6a4e638e9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:13.749878 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d31d3262-312d-4132-bcb1-f3b6a4e638e9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:13.888747 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d31d3262-312d-4132-bcb1-f3b6a4e638e9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:13.927909 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d31d3262-312d-4132-bcb1-f3b6a4e638e9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.163780 May 26 17:04:13.927909 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 374/721] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:13 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:14.432542 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-796c6a42-e254-4374-ae17-4e7c35421fd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:14.433120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-796c6a42-e254-4374-ae17-4e7c35421fd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:14.440120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-796c6a42-e254-4374-ae17-4e7c35421fd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:14.440566 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-796c6a42-e254-4374-ae17-4e7c35421fd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:14.441327 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-796c6a42-e254-4374-ae17-4e7c35421fd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:14.441758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-796c6a42-e254-4374-ae17-4e7c35421fd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:14.571717 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-796c6a42-e254-4374-ae17-4e7c35421fd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:14.581526 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-796c6a42-e254-4374-ae17-4e7c35421fd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:14.583061 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-796c6a42-e254-4374-ae17-4e7c35421fd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:14.584222 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-796c6a42-e254-4374-ae17-4e7c35421fd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.155751 May 26 17:04:14.584786 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 348/722] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:14 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:14.914696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-cfb0a671-26f4-4d62-b9ab-7049d117aea1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:14.915291 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-cfb0a671-26f4-4d62-b9ab-7049d117aea1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:14.921766 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cfb0a671-26f4-4d62-b9ab-7049d117aea1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:14.922955 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cfb0a671-26f4-4d62-b9ab-7049d117aea1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:14.923728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cfb0a671-26f4-4d62-b9ab-7049d117aea1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:14.924153 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cfb0a671-26f4-4d62-b9ab-7049d117aea1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:15.075271 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cfb0a671-26f4-4d62-b9ab-7049d117aea1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:15.083882 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-cfb0a671-26f4-4d62-b9ab-7049d117aea1 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1758 microversion: 2.1 time: 0.172922 May 26 17:04:15.084457 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 375/723] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:14 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:15.602512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-791e0715-9dcf-4acb-9380-578da8091cd6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:15.603042 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-791e0715-9dcf-4acb-9380-578da8091cd6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:15.610131 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-791e0715-9dcf-4acb-9380-578da8091cd6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:15.610637 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-791e0715-9dcf-4acb-9380-578da8091cd6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:15.611391 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-791e0715-9dcf-4acb-9380-578da8091cd6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:15.611823 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-791e0715-9dcf-4acb-9380-578da8091cd6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:15.748391 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-791e0715-9dcf-4acb-9380-578da8091cd6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:15.756982 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-791e0715-9dcf-4acb-9380-578da8091cd6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:15.758519 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-791e0715-9dcf-4acb-9380-578da8091cd6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:15.759705 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-791e0715-9dcf-4acb-9380-578da8091cd6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.161199 May 26 17:04:15.760267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 349/724] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:15 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:16.101022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ff958ad6-fe50-46cc-a61b-5543ae141a45 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:16.101627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ff958ad6-fe50-46cc-a61b-5543ae141a45 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:16.108118 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ff958ad6-fe50-46cc-a61b-5543ae141a45 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:16.108566 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ff958ad6-fe50-46cc-a61b-5543ae141a45 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:16.109323 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ff958ad6-fe50-46cc-a61b-5543ae141a45 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:16.109757 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ff958ad6-fe50-46cc-a61b-5543ae141a45 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:16.113569 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:16.250532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ff958ad6-fe50-46cc-a61b-5543ae141a45 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:16.258438 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ff958ad6-fe50-46cc-a61b-5543ae141a45 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1761 microversion: 2.1 time: 0.161276 May 26 17:04:16.259166 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 376/725] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:04:16 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1761 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:16.778734 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4fe31314-73f5-4052-aee2-270b5278878b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:16.779400 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4fe31314-73f5-4052-aee2-270b5278878b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:16.786704 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4fe31314-73f5-4052-aee2-270b5278878b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:16.787144 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4fe31314-73f5-4052-aee2-270b5278878b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:16.787898 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4fe31314-73f5-4052-aee2-270b5278878b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:16.788327 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4fe31314-73f5-4052-aee2-270b5278878b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:16.921439 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4fe31314-73f5-4052-aee2-270b5278878b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:16.931163 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4fe31314-73f5-4052-aee2-270b5278878b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:16.932642 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4fe31314-73f5-4052-aee2-270b5278878b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:16.933791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4fe31314-73f5-4052-aee2-270b5278878b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.159010 May 26 17:04:16.934377 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 350/726] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:16 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:17.952606 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c39c0b6e-8ff7-418e-80a4-12fb3ccb5e62 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:17.953277 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c39c0b6e-8ff7-418e-80a4-12fb3ccb5e62 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:17.960250 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c39c0b6e-8ff7-418e-80a4-12fb3ccb5e62 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:17.960694 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c39c0b6e-8ff7-418e-80a4-12fb3ccb5e62 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:17.961457 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c39c0b6e-8ff7-418e-80a4-12fb3ccb5e62 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:17.961908 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c39c0b6e-8ff7-418e-80a4-12fb3ccb5e62 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:18.092877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c39c0b6e-8ff7-418e-80a4-12fb3ccb5e62 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:18.102110 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c39c0b6e-8ff7-418e-80a4-12fb3ccb5e62 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:18.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c39c0b6e-8ff7-418e-80a4-12fb3ccb5e62 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:18.104865 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c39c0b6e-8ff7-418e-80a4-12fb3ccb5e62 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.156151 May 26 17:04:18.105446 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 377/727] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:17 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:19.124469 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5ec8e50c-5dcf-4d1e-8a30-80125e16b18a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:19.125164 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5ec8e50c-5dcf-4d1e-8a30-80125e16b18a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:19.132031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5ec8e50c-5dcf-4d1e-8a30-80125e16b18a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:19.132481 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5ec8e50c-5dcf-4d1e-8a30-80125e16b18a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:19.133263 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5ec8e50c-5dcf-4d1e-8a30-80125e16b18a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:19.133698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5ec8e50c-5dcf-4d1e-8a30-80125e16b18a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:19.266915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5ec8e50c-5dcf-4d1e-8a30-80125e16b18a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:19.275400 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5ec8e50c-5dcf-4d1e-8a30-80125e16b18a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:19.276905 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5ec8e50c-5dcf-4d1e-8a30-80125e16b18a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:19.278110 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5ec8e50c-5dcf-4d1e-8a30-80125e16b18a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.157580 May 26 17:04:19.278703 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 351/728] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:19 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:20.298405 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-30e82fb4-ebd4-4bc7-897c-ccb22549d26b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:20.299016 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-30e82fb4-ebd4-4bc7-897c-ccb22549d26b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:20.305483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30e82fb4-ebd4-4bc7-897c-ccb22549d26b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:20.306203 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30e82fb4-ebd4-4bc7-897c-ccb22549d26b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:20.306809 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30e82fb4-ebd4-4bc7-897c-ccb22549d26b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:20.307242 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30e82fb4-ebd4-4bc7-897c-ccb22549d26b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:20.445550 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-30e82fb4-ebd4-4bc7-897c-ccb22549d26b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:20.454506 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-30e82fb4-ebd4-4bc7-897c-ccb22549d26b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:20.455999 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-30e82fb4-ebd4-4bc7-897c-ccb22549d26b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:20.457418 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-30e82fb4-ebd4-4bc7-897c-ccb22549d26b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.164286 May 26 17:04:20.457978 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 378/729] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:20 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:21.476124 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fe550499-02fe-409f-8ec5-105a42a5de4a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:21.476677 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fe550499-02fe-409f-8ec5-105a42a5de4a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:21.483528 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe550499-02fe-409f-8ec5-105a42a5de4a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:21.483972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe550499-02fe-409f-8ec5-105a42a5de4a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:21.485261 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe550499-02fe-409f-8ec5-105a42a5de4a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:21.485700 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe550499-02fe-409f-8ec5-105a42a5de4a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:21.623182 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fe550499-02fe-409f-8ec5-105a42a5de4a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:21.632598 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fe550499-02fe-409f-8ec5-105a42a5de4a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:21.634089 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fe550499-02fe-409f-8ec5-105a42a5de4a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:21.635270 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fe550499-02fe-409f-8ec5-105a42a5de4a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.163203 May 26 17:04:21.635843 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 352/730] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:21 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:22.654125 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-adad9c32-b233-44e6-b35c-050cab2d5ddb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:22.654749 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-adad9c32-b233-44e6-b35c-050cab2d5ddb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:22.662057 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-adad9c32-b233-44e6-b35c-050cab2d5ddb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:22.662689 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-adad9c32-b233-44e6-b35c-050cab2d5ddb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:22.663473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-adad9c32-b233-44e6-b35c-050cab2d5ddb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:22.663903 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-adad9c32-b233-44e6-b35c-050cab2d5ddb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:22.792309 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-adad9c32-b233-44e6-b35c-050cab2d5ddb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:22.801587 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-adad9c32-b233-44e6-b35c-050cab2d5ddb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:22.803127 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-adad9c32-b233-44e6-b35c-050cab2d5ddb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:22.804282 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-adad9c32-b233-44e6-b35c-050cab2d5ddb tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.154181 May 26 17:04:22.804844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 379/731] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:22 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:23.823146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0803c53c-5728-4483-9836-6d6c5a5fa838 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:23.823756 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0803c53c-5728-4483-9836-6d6c5a5fa838 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:23.830550 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0803c53c-5728-4483-9836-6d6c5a5fa838 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:23.831004 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0803c53c-5728-4483-9836-6d6c5a5fa838 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:23.832028 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0803c53c-5728-4483-9836-6d6c5a5fa838 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:23.832475 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0803c53c-5728-4483-9836-6d6c5a5fa838 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:23.967936 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0803c53c-5728-4483-9836-6d6c5a5fa838 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:23.976979 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0803c53c-5728-4483-9836-6d6c5a5fa838 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:23.978523 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0803c53c-5728-4483-9836-6d6c5a5fa838 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:23.979687 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0803c53c-5728-4483-9836-6d6c5a5fa838 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.160548 May 26 17:04:23.980255 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 353/732] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:23 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:24.998502 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7f54943a-093e-49f6-88ac-0336c6de18b5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:24.999058 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7f54943a-093e-49f6-88ac-0336c6de18b5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:25.006204 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f54943a-093e-49f6-88ac-0336c6de18b5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:25.006681 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f54943a-093e-49f6-88ac-0336c6de18b5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:25.007447 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f54943a-093e-49f6-88ac-0336c6de18b5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:25.007880 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7f54943a-093e-49f6-88ac-0336c6de18b5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:25.152217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7f54943a-093e-49f6-88ac-0336c6de18b5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:25.161659 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7f54943a-093e-49f6-88ac-0336c6de18b5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:25.163214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7f54943a-093e-49f6-88ac-0336c6de18b5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:25.164369 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7f54943a-093e-49f6-88ac-0336c6de18b5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.169978 May 26 17:04:25.164982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 380/733] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:24 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:26.184974 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e9aa579c-0935-48fc-89cf-8e785ea4335c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:26.185599 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e9aa579c-0935-48fc-89cf-8e785ea4335c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:26.192998 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9aa579c-0935-48fc-89cf-8e785ea4335c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:26.193451 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9aa579c-0935-48fc-89cf-8e785ea4335c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:26.194257 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9aa579c-0935-48fc-89cf-8e785ea4335c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:26.194723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e9aa579c-0935-48fc-89cf-8e785ea4335c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:26.326412 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e9aa579c-0935-48fc-89cf-8e785ea4335c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:26.336214 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e9aa579c-0935-48fc-89cf-8e785ea4335c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:26.337274 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e9aa579c-0935-48fc-89cf-8e785ea4335c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:26.338496 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e9aa579c-0935-48fc-89cf-8e785ea4335c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.157392 May 26 17:04:26.339066 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 354/734] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:26 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:27.357227 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3f894060-cc2c-4f43-96c7-0ba04b48c742 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:27.357767 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3f894060-cc2c-4f43-96c7-0ba04b48c742 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:27.363797 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f894060-cc2c-4f43-96c7-0ba04b48c742 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:27.364237 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f894060-cc2c-4f43-96c7-0ba04b48c742 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:27.364999 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f894060-cc2c-4f43-96c7-0ba04b48c742 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:27.365426 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f894060-cc2c-4f43-96c7-0ba04b48c742 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:27.500575 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3f894060-cc2c-4f43-96c7-0ba04b48c742 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:27.509085 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3f894060-cc2c-4f43-96c7-0ba04b48c742 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:27.510604 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3f894060-cc2c-4f43-96c7-0ba04b48c742 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:27.511758 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3f894060-cc2c-4f43-96c7-0ba04b48c742 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.158764 May 26 17:04:27.512319 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 381/735] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:27 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:28.531286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-13e27ba8-25de-4fd9-acb8-bee830005bac tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:28.532362 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-13e27ba8-25de-4fd9-acb8-bee830005bac tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:28.534689 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=44 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:28.539464 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-13e27ba8-25de-4fd9-acb8-bee830005bac tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:28.539915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-13e27ba8-25de-4fd9-acb8-bee830005bac tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:28.540716 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-13e27ba8-25de-4fd9-acb8-bee830005bac tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:28.541157 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-13e27ba8-25de-4fd9-acb8-bee830005bac tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:28.677705 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-13e27ba8-25de-4fd9-acb8-bee830005bac tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:28.686531 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-13e27ba8-25de-4fd9-acb8-bee830005bac tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:28.688124 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-13e27ba8-25de-4fd9-acb8-bee830005bac tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:28.689283 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-13e27ba8-25de-4fd9-acb8-bee830005bac tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.162072 May 26 17:04:28.689857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 355/736] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:28 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:29.707812 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-30a9939c-1180-44aa-8f30-e7153ea299fc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:29.708430 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-30a9939c-1180-44aa-8f30-e7153ea299fc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:29.710737 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=42 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:29.715466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30a9939c-1180-44aa-8f30-e7153ea299fc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:29.715913 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30a9939c-1180-44aa-8f30-e7153ea299fc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:29.716776 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30a9939c-1180-44aa-8f30-e7153ea299fc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:29.717210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30a9939c-1180-44aa-8f30-e7153ea299fc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:29.784668 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-a15c2995-8b01-48af-abf7-6dadd936fc57 req-39536c10-4560-4983-937d-c9d26789e193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e5f6d0-3136-4741-a4c4-916b792ee1c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf8c749f-cafe-414f-850e-85d42f33c2db"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:29.792822 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-a15c2995-8b01-48af-abf7-6dadd936fc57 req-39536c10-4560-4983-937d-c9d26789e193 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:29.793375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-a15c2995-8b01-48af-abf7-6dadd936fc57 req-39536c10-4560-4983-937d-c9d26789e193 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:29.805168 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-a15c2995-8b01-48af-abf7-6dadd936fc57 req-39536c10-4560-4983-937d-c9d26789e193 service nova] Creating event network-vif-plugged:bf8c749f-cafe-414f-850e-85d42f33c2db for instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 on hv-cinder-83607 May 26 17:04:29.810766 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-a15c2995-8b01-48af-abf7-6dadd936fc57 req-39536c10-4560-4983-937d-c9d26789e193 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087588 May 26 17:04:29.811404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 356/737] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:04:29.858122 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-30a9939c-1180-44aa-8f30-e7153ea299fc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:29.867847 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-30a9939c-1180-44aa-8f30-e7153ea299fc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:29.870574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-30a9939c-1180-44aa-8f30-e7153ea299fc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:29.870719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-30a9939c-1180-44aa-8f30-e7153ea299fc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.166856 May 26 17:04:29.871237 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 382/738] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:29 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:30.889652 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c6b794da-580f-4d13-9784-77bcf3ae3613 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:30.890488 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c6b794da-580f-4d13-9784-77bcf3ae3613 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:30.898728 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c6b794da-580f-4d13-9784-77bcf3ae3613 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:30.899180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c6b794da-580f-4d13-9784-77bcf3ae3613 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:30.899956 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c6b794da-580f-4d13-9784-77bcf3ae3613 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:30.900390 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c6b794da-580f-4d13-9784-77bcf3ae3613 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:31.080578 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c6b794da-580f-4d13-9784-77bcf3ae3613 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:31.083254 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:31.090515 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c6b794da-580f-4d13-9784-77bcf3ae3613 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:31.092041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c6b794da-580f-4d13-9784-77bcf3ae3613 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:31.093936 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c6b794da-580f-4d13-9784-77bcf3ae3613 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.207971 May 26 17:04:31.094578 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 357/739] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:30 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:32.113205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-981f8cde-2fac-4d3f-a662-32bf1883d51e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:32.113807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-981f8cde-2fac-4d3f-a662-32bf1883d51e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:32.120437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-981f8cde-2fac-4d3f-a662-32bf1883d51e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:32.120883 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-981f8cde-2fac-4d3f-a662-32bf1883d51e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:32.121645 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-981f8cde-2fac-4d3f-a662-32bf1883d51e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:32.122080 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-981f8cde-2fac-4d3f-a662-32bf1883d51e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:32.259842 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-981f8cde-2fac-4d3f-a662-32bf1883d51e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:32.268845 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-981f8cde-2fac-4d3f-a662-32bf1883d51e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:32.270348 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-981f8cde-2fac-4d3f-a662-32bf1883d51e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:32.271549 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-981f8cde-2fac-4d3f-a662-32bf1883d51e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.162918 May 26 17:04:32.272109 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 383/740] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:32 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:33.291056 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0c8a0023-d5c7-4372-82c3-dbe134d939b2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:33.323031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0c8a0023-d5c7-4372-82c3-dbe134d939b2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:33.323031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0c8a0023-d5c7-4372-82c3-dbe134d939b2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:33.323031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0c8a0023-d5c7-4372-82c3-dbe134d939b2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:33.323031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0c8a0023-d5c7-4372-82c3-dbe134d939b2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:33.323443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0c8a0023-d5c7-4372-82c3-dbe134d939b2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:33.450243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0c8a0023-d5c7-4372-82c3-dbe134d939b2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:33.457330 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0c8a0023-d5c7-4372-82c3-dbe134d939b2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:33.458761 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0c8a0023-d5c7-4372-82c3-dbe134d939b2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:33.459907 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0c8a0023-d5c7-4372-82c3-dbe134d939b2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.172788 May 26 17:04:33.460466 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 358/741] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:33 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:34.478601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e95eee46-5592-4991-a2c6-35c441b5566d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:34.479165 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e95eee46-5592-4991-a2c6-35c441b5566d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:34.486234 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e95eee46-5592-4991-a2c6-35c441b5566d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:34.486713 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e95eee46-5592-4991-a2c6-35c441b5566d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:34.487487 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e95eee46-5592-4991-a2c6-35c441b5566d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:34.487922 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e95eee46-5592-4991-a2c6-35c441b5566d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:34.618380 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e95eee46-5592-4991-a2c6-35c441b5566d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:34.627319 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e95eee46-5592-4991-a2c6-35c441b5566d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:34.628809 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e95eee46-5592-4991-a2c6-35c441b5566d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:34.629974 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e95eee46-5592-4991-a2c6-35c441b5566d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.155444 May 26 17:04:34.630562 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 384/742] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:34 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:35.649196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ed09221b-b612-4811-855b-092529399bc8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:35.649822 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ed09221b-b612-4811-855b-092529399bc8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:35.657263 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed09221b-b612-4811-855b-092529399bc8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:35.657700 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed09221b-b612-4811-855b-092529399bc8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:35.658519 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed09221b-b612-4811-855b-092529399bc8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:35.658976 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed09221b-b612-4811-855b-092529399bc8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:35.795187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ed09221b-b612-4811-855b-092529399bc8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:35.804549 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ed09221b-b612-4811-855b-092529399bc8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:35.806062 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ed09221b-b612-4811-855b-092529399bc8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:35.807257 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ed09221b-b612-4811-855b-092529399bc8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.162015 May 26 17:04:35.807857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 359/743] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:35 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:04:36.825939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b589fae3-651c-45d8-bfaa-6299734e5f41 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:36.826713 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b589fae3-651c-45d8-bfaa-6299734e5f41 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:36.839446 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b589fae3-651c-45d8-bfaa-6299734e5f41 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:36.839901 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b589fae3-651c-45d8-bfaa-6299734e5f41 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:36.840712 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b589fae3-651c-45d8-bfaa-6299734e5f41 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:36.841154 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b589fae3-651c-45d8-bfaa-6299734e5f41 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:36.997388 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b589fae3-651c-45d8-bfaa-6299734e5f41 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:37.007493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b589fae3-651c-45d8-bfaa-6299734e5f41 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:37.009897 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b589fae3-651c-45d8-bfaa-6299734e5f41 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:37.010252 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b589fae3-651c-45d8-bfaa-6299734e5f41 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1812 microversion: 2.20 time: 0.188993 May 26 17:04:37.011085 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 385/744] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:36 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1812 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:04:38.029244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5d120d1e-a0aa-49c0-98eb-f1bc8d288aa4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:38.029853 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5d120d1e-a0aa-49c0-98eb-f1bc8d288aa4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:38.036841 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5d120d1e-a0aa-49c0-98eb-f1bc8d288aa4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:38.037293 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5d120d1e-a0aa-49c0-98eb-f1bc8d288aa4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:38.038062 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5d120d1e-a0aa-49c0-98eb-f1bc8d288aa4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:38.038528 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5d120d1e-a0aa-49c0-98eb-f1bc8d288aa4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:38.166249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5d120d1e-a0aa-49c0-98eb-f1bc8d288aa4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:38.175601 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5d120d1e-a0aa-49c0-98eb-f1bc8d288aa4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:38.177099 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5d120d1e-a0aa-49c0-98eb-f1bc8d288aa4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:38.178265 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5d120d1e-a0aa-49c0-98eb-f1bc8d288aa4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1799 microversion: 2.20 time: 0.152984 May 26 17:04:38.178890 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 360/745] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:04:38 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:05:08.941825 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0461adfc-a67e-4e70-ac72-52d64024d201 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:08.942473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0461adfc-a67e-4e70-ac72-52d64024d201 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:08.944356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=7 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:08.945012 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=59 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:08.949827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0461adfc-a67e-4e70-ac72-52d64024d201 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:08.950275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0461adfc-a67e-4e70-ac72-52d64024d201 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:08.952183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0461adfc-a67e-4e70-ac72-52d64024d201 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:08.952664 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0461adfc-a67e-4e70-ac72-52d64024d201 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:09.092285 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-0461adfc-a67e-4e70-ac72-52d64024d201 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lazy-loading 'services' on Instance uuid a551b1e0-dd51-440e-bf6f-b0600939ddeb {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:05:09.377195 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0461adfc-a67e-4e70-ac72-52d64024d201 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "DELETE /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/os-volume_attachments/53b12efc-1991-4224-b745-76af58409c99" status: 202 len: 0 microversion: 2.1 time: 0.439324 May 26 17:05:09.377785 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 386/746] 10.222.0.112 () {58 vars in 1420 bytes} [Thu May 26 17:05:08 2022] DELETE /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/os-volume_attachments/53b12efc-1991-4224-b745-76af58409c99 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:05:10.915729 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cd9c956f-bd68-4a35-b4e5-b7821d999d21 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:10.916291 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cd9c956f-bd68-4a35-b4e5-b7821d999d21 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:10.918256 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=11 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:10.918937 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=19 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:10.923959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd9c956f-bd68-4a35-b4e5-b7821d999d21 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:10.924408 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd9c956f-bd68-4a35-b4e5-b7821d999d21 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:10.925165 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd9c956f-bd68-4a35-b4e5-b7821d999d21 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:10.925607 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd9c956f-bd68-4a35-b4e5-b7821d999d21 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:10.950197 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cd9c956f-bd68-4a35-b4e5-b7821d999d21 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Going to try to terminate instance {{(pid=130525) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:05:11.400507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cd9c956f-bd68-4a35-b4e5-b7821d999d21 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "DELETE /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 204 len: 0 microversion: 2.1 time: 0.488541 May 26 17:05:11.401109 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 361/747] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:05:10 2022] DELETE /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 17:05:11.410432 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-48bb6712-3e15-4827-92fd-24567f0e4936 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:11.411134 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-48bb6712-3e15-4827-92fd-24567f0e4936 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:11.417361 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48bb6712-3e15-4827-92fd-24567f0e4936 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:11.417811 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48bb6712-3e15-4827-92fd-24567f0e4936 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:11.418602 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48bb6712-3e15-4827-92fd-24567f0e4936 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:11.419543 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48bb6712-3e15-4827-92fd-24567f0e4936 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:11.556546 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-09c2df63-9928-4c7f-84d5-1dd5c7c48909 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:11.563009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-48bb6712-3e15-4827-92fd-24567f0e4936 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:11.563633 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-09c2df63-9928-4c7f-84d5-1dd5c7c48909 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:11.564090 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-09c2df63-9928-4c7f-84d5-1dd5c7c48909 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:11.570796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-48bb6712-3e15-4827-92fd-24567f0e4936 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1581 microversion: 2.1 time: 0.164982 May 26 17:05:11.571533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 387/748] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:11 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1581 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:11.624118 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-09c2df63-9928-4c7f-84d5-1dd5c7c48909 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Going to try to stop instance {{(pid=130525) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 17:05:11.854103 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-09c2df63-9928-4c7f-84d5-1dd5c7c48909 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "POST /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/action" status: 202 len: 0 microversion: 2.1 time: 0.301527 May 26 17:05:11.854706 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 362/749] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:05:11 2022] POST /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:05:11.863327 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a39c6b9f-ef89-4d7d-afb4-36456a314f38 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:11.863940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a39c6b9f-ef89-4d7d-afb4-36456a314f38 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:11.870272 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a39c6b9f-ef89-4d7d-afb4-36456a314f38 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:11.870802 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a39c6b9f-ef89-4d7d-afb4-36456a314f38 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:11.871567 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a39c6b9f-ef89-4d7d-afb4-36456a314f38 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:11.872003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a39c6b9f-ef89-4d7d-afb4-36456a314f38 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:12.007881 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a39c6b9f-ef89-4d7d-afb4-36456a314f38 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:12.017580 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a39c6b9f-ef89-4d7d-afb4-36456a314f38 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.158085 May 26 17:05:12.018158 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 388/750] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:11 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:12.590133 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f3b1772e-7d77-4153-8034-e707196d39c7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:12.590777 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f3b1772e-7d77-4153-8034-e707196d39c7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:12.597566 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f3b1772e-7d77-4153-8034-e707196d39c7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:12.598017 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f3b1772e-7d77-4153-8034-e707196d39c7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:12.598814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f3b1772e-7d77-4153-8034-e707196d39c7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:12.599250 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f3b1772e-7d77-4153-8034-e707196d39c7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:12.746411 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f3b1772e-7d77-4153-8034-e707196d39c7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:12.754770 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f3b1772e-7d77-4153-8034-e707196d39c7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1581 microversion: 2.1 time: 0.169391 May 26 17:05:12.755351 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 363/751] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:12 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1581 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:13.035899 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-189eb779-933d-40f1-b5ae-6c401435c0fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:13.036700 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-189eb779-933d-40f1-b5ae-6c401435c0fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:13.043445 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-189eb779-933d-40f1-b5ae-6c401435c0fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:13.043998 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-189eb779-933d-40f1-b5ae-6c401435c0fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:13.045466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-189eb779-933d-40f1-b5ae-6c401435c0fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:13.045907 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-189eb779-933d-40f1-b5ae-6c401435c0fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:13.175471 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-189eb779-933d-40f1-b5ae-6c401435c0fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:13.183526 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-189eb779-933d-40f1-b5ae-6c401435c0fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1728 microversion: 2.1 time: 0.151521 May 26 17:05:13.184102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 389/752] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:13 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:13.772746 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-dbdabc39-015f-4ae5-a1f5-208288b5d458 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:13.773364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-dbdabc39-015f-4ae5-a1f5-208288b5d458 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:13.780445 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dbdabc39-015f-4ae5-a1f5-208288b5d458 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:13.780890 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dbdabc39-015f-4ae5-a1f5-208288b5d458 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:13.781664 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dbdabc39-015f-4ae5-a1f5-208288b5d458 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:13.782146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dbdabc39-015f-4ae5-a1f5-208288b5d458 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:13.915174 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-dbdabc39-015f-4ae5-a1f5-208288b5d458 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:13.923608 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-dbdabc39-015f-4ae5-a1f5-208288b5d458 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1581 microversion: 2.1 time: 0.154798 May 26 17:05:13.924433 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 364/753] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:13 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1581 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:14.052848 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1f61384e-0511-44dc-a293-6ce8feefdd78 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a25459d1-2b07-4418-be96-1aaecf81518d"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:14.053971 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1f61384e-0511-44dc-a293-6ce8feefdd78 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:14.060844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1f61384e-0511-44dc-a293-6ce8feefdd78 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:14.061248 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1f61384e-0511-44dc-a293-6ce8feefdd78 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:14.062023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1f61384e-0511-44dc-a293-6ce8feefdd78 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:14.062487 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1f61384e-0511-44dc-a293-6ce8feefdd78 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:14.203322 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c062e1cf-1f02-48d8-94dd-7fad98784870 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:14.203855 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c062e1cf-1f02-48d8-94dd-7fad98784870 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:14.210226 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c062e1cf-1f02-48d8-94dd-7fad98784870 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:14.210709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c062e1cf-1f02-48d8-94dd-7fad98784870 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:14.211497 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c062e1cf-1f02-48d8-94dd-7fad98784870 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:14.212539 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c062e1cf-1f02-48d8-94dd-7fad98784870 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:14.339862 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c062e1cf-1f02-48d8-94dd-7fad98784870 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:14.347263 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c062e1cf-1f02-48d8-94dd-7fad98784870 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.148144 May 26 17:05:14.347829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 365/754] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:14 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:14.940341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-62d8a276-d7bf-44f1-a118-1b8f01095323 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:14.941034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-62d8a276-d7bf-44f1-a118-1b8f01095323 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:14.947437 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-62d8a276-d7bf-44f1-a118-1b8f01095323 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:14.947890 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-62d8a276-d7bf-44f1-a118-1b8f01095323 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:14.950941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-62d8a276-d7bf-44f1-a118-1b8f01095323 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:14.950941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-62d8a276-d7bf-44f1-a118-1b8f01095323 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:15.164652 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-62d8a276-d7bf-44f1-a118-1b8f01095323 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:15.172661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-62d8a276-d7bf-44f1-a118-1b8f01095323 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1581 microversion: 2.1 time: 0.236136 May 26 17:05:15.173253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 366/755] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:14 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1581 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:15.365043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1a3c001d-4b3b-4c1c-b621-7fe414ae9c10 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:15.365830 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1a3c001d-4b3b-4c1c-b621-7fe414ae9c10 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:15.369559 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1f61384e-0511-44dc-a293-6ce8feefdd78 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "POST /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.429657 May 26 17:05:15.370282 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 390/756] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:05:13 2022] POST /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments => generated 194 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:15.391021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1a3c001d-4b3b-4c1c-b621-7fe414ae9c10 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:15.391021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1a3c001d-4b3b-4c1c-b621-7fe414ae9c10 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:15.391021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1a3c001d-4b3b-4c1c-b621-7fe414ae9c10 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:15.391021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1a3c001d-4b3b-4c1c-b621-7fe414ae9c10 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:15.621985 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1a3c001d-4b3b-4c1c-b621-7fe414ae9c10 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:15.630099 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1a3c001d-4b3b-4c1c-b621-7fe414ae9c10 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.268994 May 26 17:05:15.630712 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 367/757] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:15 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:16.132122 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-085d2bea-8e32-4854-9820-b8c69231cea0 req-a14554be-0d0e-408e-83b3-8b3b3a549329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd9cd4a-70e0-4506-b13a-39216e5b70c2", "name": "network-vif-deleted", "tag": "c3b9d0aa-720f-4769-bd72-2f345752623b"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:16.141807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-085d2bea-8e32-4854-9820-b8c69231cea0 req-a14554be-0d0e-408e-83b3-8b3b3a549329 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:16.142771 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-085d2bea-8e32-4854-9820-b8c69231cea0 req-a14554be-0d0e-408e-83b3-8b3b3a549329 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:16.158074 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-085d2bea-8e32-4854-9820-b8c69231cea0 req-a14554be-0d0e-408e-83b3-8b3b3a549329 service nova] Creating event network-vif-deleted:c3b9d0aa-720f-4769-bd72-2f345752623b for instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 on hv-cinder-83607 May 26 17:05:16.162849 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-085d2bea-8e32-4854-9820-b8c69231cea0 req-a14554be-0d0e-408e-83b3-8b3b3a549329 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096470 May 26 17:05:16.163448 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 391/758] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:16.189954 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7f7e602e-f36a-405e-b1bb-780ed228a718 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:16.190762 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7f7e602e-f36a-405e-b1bb-780ed228a718 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:16.203080 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7f7e602e-f36a-405e-b1bb-780ed228a718 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:16.203613 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7f7e602e-f36a-405e-b1bb-780ed228a718 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:16.204489 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7f7e602e-f36a-405e-b1bb-780ed228a718 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:16.205842 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7f7e602e-f36a-405e-b1bb-780ed228a718 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:16.276769 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7f7e602e-f36a-405e-b1bb-780ed228a718 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:16.285607 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7f7e602e-f36a-405e-b1bb-780ed228a718 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1513 microversion: 2.1 time: 0.099207 May 26 17:05:16.286492 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 368/759] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:16 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1513 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:16.648135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-69f30e6d-1a9f-46a6-8e23-b2915ac6e21d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:16.649054 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-69f30e6d-1a9f-46a6-8e23-b2915ac6e21d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:16.655998 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-69f30e6d-1a9f-46a6-8e23-b2915ac6e21d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:16.656547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-69f30e6d-1a9f-46a6-8e23-b2915ac6e21d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:16.657404 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-69f30e6d-1a9f-46a6-8e23-b2915ac6e21d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:16.657916 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-69f30e6d-1a9f-46a6-8e23-b2915ac6e21d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:16.799285 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-69f30e6d-1a9f-46a6-8e23-b2915ac6e21d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:16.807259 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-69f30e6d-1a9f-46a6-8e23-b2915ac6e21d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.163411 May 26 17:05:16.807827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 392/760] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:16 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:17.303514 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-bed64733-0ec0-4abf-89ea-63093abbd88d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:17.304274 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-bed64733-0ec0-4abf-89ea-63093abbd88d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:17.311392 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bed64733-0ec0-4abf-89ea-63093abbd88d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:17.311938 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bed64733-0ec0-4abf-89ea-63093abbd88d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:17.312736 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bed64733-0ec0-4abf-89ea-63093abbd88d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:17.313226 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bed64733-0ec0-4abf-89ea-63093abbd88d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:17.349874 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bed64733-0ec0-4abf-89ea-63093abbd88d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:17.350345 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bed64733-0ec0-4abf-89ea-63093abbd88d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:17.350803 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-bed64733-0ec0-4abf-89ea-63093abbd88d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lazy-loading 'fault' on Instance uuid cbd9cd4a-70e0-4506-b13a-39216e5b70c2 {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:05:17.398567 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bed64733-0ec0-4abf-89ea-63093abbd88d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:17.412427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-bed64733-0ec0-4abf-89ea-63093abbd88d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 200 len: 1234 microversion: 2.1 time: 0.107198 May 26 17:05:17.412427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 369/761] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:17 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 1234 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:17.825971 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7c9ede80-efe1-46df-9aa7-de548a920eb2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:17.826771 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7c9ede80-efe1-46df-9aa7-de548a920eb2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:17.833923 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c9ede80-efe1-46df-9aa7-de548a920eb2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:17.834412 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c9ede80-efe1-46df-9aa7-de548a920eb2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:17.835193 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c9ede80-efe1-46df-9aa7-de548a920eb2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:17.835630 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c9ede80-efe1-46df-9aa7-de548a920eb2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:17.976209 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7c9ede80-efe1-46df-9aa7-de548a920eb2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:17.983901 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7c9ede80-efe1-46df-9aa7-de548a920eb2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.162963 May 26 17:05:17.986957 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 393/762] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:17 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:18.424684 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4207ff75-c08e-4a98-bc15-6405961682d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:18.425364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4207ff75-c08e-4a98-bc15-6405961682d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:18.431946 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4207ff75-c08e-4a98-bc15-6405961682d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:18.432389 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4207ff75-c08e-4a98-bc15-6405961682d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:18.433151 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4207ff75-c08e-4a98-bc15-6405961682d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:18.433582 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4207ff75-c08e-4a98-bc15-6405961682d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:18.607530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-4207ff75-c08e-4a98-bc15-6405961682d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] HTTP exception thrown: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4207ff75-c08e-4a98-bc15-6405961682d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Request method failure captured: May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 HTTP/1.1 May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7IWC8FDQR8r2fIIzzAh7BnRmXOYTh4TWSi0hcJ3C6yH5-H8Yla95yIAVFbiY-FAeNYP0fd5p4xGPd5NUxO7uBbvRLPQc5L4nza_JFBSotvduni7sabuzDZLyUBQoPF2f0dju-fOVjTC3xl-k0JMYoRxkKq54rqAN1lLGU5dsBoGc4k May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: ed4f536fcafe46b5ae159b93acb7e041 May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-TestVolumeBootPattern-862722930 May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:05:18.609093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:05:18.610809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_ed4f536fcafe46b5ae159b93acb7e041"}]}] May 26 17:05:18.610809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-TestVolumeBootPattern-862722930 May 26 17:05:18.610809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: ed4f536fcafe46b5ae159b93acb7e041 May 26 17:05:18.610809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-TestVolumeBootPattern-862722930 May 26 17:05:18.610809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-TestVolumeBootPattern-862722930-project May 26 17:05:18.610809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:05:18.610809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:05:18.610809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 530b2b1951644755afd1432381cf37f9 May 26 17:05:18.610809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-TestVolumeBootPattern-862722930-project May 26 17:05:18.610809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:05:18.610809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:05:18.610809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': 'cbd9cd4a-70e0-4506-b13a-39216e5b70c2'} May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:05:18.611748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:05:18.613524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:05:18.615178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4207ff75-c08e-4a98-bc15-6405961682d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Returning 404 to user: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:05:18.615178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4207ff75-c08e-4a98-bc15-6405961682d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 404 len: 111 microversion: 2.1 time: 0.189816 May 26 17:05:18.618753 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 370/763] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:18 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:05:18.716683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-544606037", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2141156347", "security_groups": [{"name": "tempest-secgroup-smoke-1976980798"}], "block_device_mapping_v2": [{"uuid": "a9371076-e47e-4a2f-9969-a6acd0e1025d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "73acc420-8851-42b7-81fc-cd9808652b9c"}]}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:18.832390 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.network.neutron [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] validate_networks() for [('73acc420-8851-42b7-81fc-cd9808652b9c', None, None, None, None, None)] {{(pid=130526) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:05:19.001615 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fab1f18d-9c9b-423d-a148-ee6f1d8e6fc8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:19.002508 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fab1f18d-9c9b-423d-a148-ee6f1d8e6fc8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:19.008525 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fab1f18d-9c9b-423d-a148-ee6f1d8e6fc8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:19.009178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fab1f18d-9c9b-423d-a148-ee6f1d8e6fc8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:19.009959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fab1f18d-9c9b-423d-a148-ee6f1d8e6fc8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:19.010416 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fab1f18d-9c9b-423d-a148-ee6f1d8e6fc8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:19.145154 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fab1f18d-9c9b-423d-a148-ee6f1d8e6fc8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:19.153447 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fab1f18d-9c9b-423d-a148-ee6f1d8e6fc8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.155831 May 26 17:05:19.163969 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 371/764] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:18 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:19.251064 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Flavor limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:05:19.251485 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Image limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:05:19.251953 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Flavor pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:05:19.252384 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Image pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:05:19.252900 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:05:19.262143 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:19.262619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:19.263790 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:19.264230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:19.281490 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Getting quotas for project ed4f536fcafe46b5ae159b93acb7e041. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:05:19.285404 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Getting quotas for user 530b2b1951644755afd1432381cf37f9 and project ed4f536fcafe46b5ae159b93acb7e041. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:05:19.343475 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Going to run 1 instances... {{(pid=130526) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:05:19.345682 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a9371076-e47e-4a2f-9969-a6acd0e1025d',volume_size=None,volume_type=None)] {{(pid=130526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:05:19.899126 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5c846e3d-a876-4ee2-abb5-33a77926a5b6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.186775 May 26 17:05:19.900484 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 394/765] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:05:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:05:19.910888 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e8e1ef74-a151-47f6-aa0a-c89b41cb2938 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:19.911645 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e8e1ef74-a151-47f6-aa0a-c89b41cb2938 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:19.966808 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e8e1ef74-a151-47f6-aa0a-c89b41cb2938 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:19.973564 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e8e1ef74-a151-47f6-aa0a-c89b41cb2938 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1097 microversion: 2.1 time: 0.066625 May 26 17:05:19.974131 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 372/766] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:19 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1097 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:20.171617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-39993650-6c2a-4094-be26-c48112745193 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:20.172178 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-39993650-6c2a-4094-be26-c48112745193 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:20.178359 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-39993650-6c2a-4094-be26-c48112745193 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:20.178818 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-39993650-6c2a-4094-be26-c48112745193 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:20.179591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-39993650-6c2a-4094-be26-c48112745193 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:20.180028 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-39993650-6c2a-4094-be26-c48112745193 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:20.313602 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-39993650-6c2a-4094-be26-c48112745193 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:20.321335 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-39993650-6c2a-4094-be26-c48112745193 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.154217 May 26 17:05:20.321908 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 395/767] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:20 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:20.991408 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b2304704-3546-400c-8ff3-c4d63cb2944b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:20.992064 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b2304704-3546-400c-8ff3-c4d63cb2944b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:20.999872 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b2304704-3546-400c-8ff3-c4d63cb2944b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:21.002588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b2304704-3546-400c-8ff3-c4d63cb2944b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:21.002588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b2304704-3546-400c-8ff3-c4d63cb2944b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:21.002588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b2304704-3546-400c-8ff3-c4d63cb2944b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:21.063164 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b2304704-3546-400c-8ff3-c4d63cb2944b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:21.070719 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b2304704-3546-400c-8ff3-c4d63cb2944b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1147 microversion: 2.1 time: 0.083094 May 26 17:05:21.071286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 373/768] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:20 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1147 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:21.339709 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-65660b11-4458-4a1d-b7d3-be991c7da7af tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:21.340257 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-65660b11-4458-4a1d-b7d3-be991c7da7af tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:21.347138 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-65660b11-4458-4a1d-b7d3-be991c7da7af tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:21.347590 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-65660b11-4458-4a1d-b7d3-be991c7da7af tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:21.348359 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-65660b11-4458-4a1d-b7d3-be991c7da7af tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:21.348803 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-65660b11-4458-4a1d-b7d3-be991c7da7af tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:21.485603 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-65660b11-4458-4a1d-b7d3-be991c7da7af tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:21.493268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-65660b11-4458-4a1d-b7d3-be991c7da7af tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.157506 May 26 17:05:21.493843 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 396/769] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:21 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:22.088845 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7241ecd2-bb6b-462e-a7df-5b50c43e5ed0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:22.089489 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7241ecd2-bb6b-462e-a7df-5b50c43e5ed0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:22.096923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7241ecd2-bb6b-462e-a7df-5b50c43e5ed0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:22.097377 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7241ecd2-bb6b-462e-a7df-5b50c43e5ed0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:22.098164 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7241ecd2-bb6b-462e-a7df-5b50c43e5ed0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:22.098626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7241ecd2-bb6b-462e-a7df-5b50c43e5ed0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:22.163582 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7241ecd2-bb6b-462e-a7df-5b50c43e5ed0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:22.171490 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7241ecd2-bb6b-462e-a7df-5b50c43e5ed0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1195 microversion: 2.1 time: 0.086677 May 26 17:05:22.172069 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 374/770] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:22 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1195 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:22.511567 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d252af87-6927-4103-8d19-186f8defc95e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:22.512183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d252af87-6927-4103-8d19-186f8defc95e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:22.519341 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d252af87-6927-4103-8d19-186f8defc95e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:22.519788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d252af87-6927-4103-8d19-186f8defc95e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:22.520543 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d252af87-6927-4103-8d19-186f8defc95e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:22.520984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d252af87-6927-4103-8d19-186f8defc95e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:22.659544 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d252af87-6927-4103-8d19-186f8defc95e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:22.666407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d252af87-6927-4103-8d19-186f8defc95e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.158761 May 26 17:05:22.666951 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 397/771] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:22 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:23.189104 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c3dcf915-87f7-4e14-991e-40eeb0e03c87 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:23.190547 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c3dcf915-87f7-4e14-991e-40eeb0e03c87 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:23.202790 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c3dcf915-87f7-4e14-991e-40eeb0e03c87 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:23.202790 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c3dcf915-87f7-4e14-991e-40eeb0e03c87 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:23.203441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c3dcf915-87f7-4e14-991e-40eeb0e03c87 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:23.203879 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c3dcf915-87f7-4e14-991e-40eeb0e03c87 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:23.279372 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c3dcf915-87f7-4e14-991e-40eeb0e03c87 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:23.286933 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c3dcf915-87f7-4e14-991e-40eeb0e03c87 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1203 microversion: 2.1 time: 0.101656 May 26 17:05:23.287505 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 375/772] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:23 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1203 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:23.684024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9d591018-3679-4056-8489-eb13e51ed2d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:23.684860 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9d591018-3679-4056-8489-eb13e51ed2d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:23.700471 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9d591018-3679-4056-8489-eb13e51ed2d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:23.700471 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9d591018-3679-4056-8489-eb13e51ed2d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:23.700471 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9d591018-3679-4056-8489-eb13e51ed2d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:23.700471 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9d591018-3679-4056-8489-eb13e51ed2d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:23.835680 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9d591018-3679-4056-8489-eb13e51ed2d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:23.844329 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9d591018-3679-4056-8489-eb13e51ed2d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.164142 May 26 17:05:23.844908 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 398/773] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:23 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:24.304964 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fe23b6bb-5278-4d37-9dad-0bc4679dd2b0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:24.306169 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fe23b6bb-5278-4d37-9dad-0bc4679dd2b0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:24.314768 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe23b6bb-5278-4d37-9dad-0bc4679dd2b0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:24.315201 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe23b6bb-5278-4d37-9dad-0bc4679dd2b0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:24.316031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe23b6bb-5278-4d37-9dad-0bc4679dd2b0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:24.316464 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe23b6bb-5278-4d37-9dad-0bc4679dd2b0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:24.321021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:24.557535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f2b5986d-0a50-41db-9614-ac8311ffa632 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:24.558596 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f2b5986d-0a50-41db-9614-ac8311ffa632 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:24.564688 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fe23b6bb-5278-4d37-9dad-0bc4679dd2b0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:24.565404 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f2b5986d-0a50-41db-9614-ac8311ffa632 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:24.565862 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f2b5986d-0a50-41db-9614-ac8311ffa632 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:24.566685 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f2b5986d-0a50-41db-9614-ac8311ffa632 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:24.567302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f2b5986d-0a50-41db-9614-ac8311ffa632 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:24.572631 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fe23b6bb-5278-4d37-9dad-0bc4679dd2b0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1281 microversion: 2.1 time: 0.271650 May 26 17:05:24.573205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 376/774] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:24 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1281 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:24.593263 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-f2b5986d-0a50-41db-9614-ac8311ffa632 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lazy-loading 'flavor' on Instance uuid ea078281-ddf9-4637-9cfd-ca0709e2e74d {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:05:24.861465 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5800410f-b10b-420e-a458-050c3ddad30e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:24.862075 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5800410f-b10b-420e-a458-050c3ddad30e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:24.868020 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5800410f-b10b-420e-a458-050c3ddad30e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:24.868487 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5800410f-b10b-420e-a458-050c3ddad30e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:24.869236 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5800410f-b10b-420e-a458-050c3ddad30e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:24.869676 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5800410f-b10b-420e-a458-050c3ddad30e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:24.970925 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:25.054735 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5800410f-b10b-420e-a458-050c3ddad30e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:25.065976 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5800410f-b10b-420e-a458-050c3ddad30e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.206748 May 26 17:05:25.065976 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 377/775] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:24 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:25.145407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f2b5986d-0a50-41db-9614-ac8311ffa632 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "POST /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/action" status: 200 len: 32 microversion: 2.1 time: 0.591820 May 26 17:05:25.146349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 399/776] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:05:24 2022] POST /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/action => generated 32 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 17:05:25.156571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7ac74fb8-d148-4fac-b3a0-d40b6283514c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:25.157599 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7ac74fb8-d148-4fac-b3a0-d40b6283514c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:25.164704 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7ac74fb8-d148-4fac-b3a0-d40b6283514c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:25.168816 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7ac74fb8-d148-4fac-b3a0-d40b6283514c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:25.168816 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7ac74fb8-d148-4fac-b3a0-d40b6283514c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:25.168816 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7ac74fb8-d148-4fac-b3a0-d40b6283514c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:25.398712 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-5c97ee00-538d-4956-9f98-1892e266928a req-824a4032-2996-41a8-9e59-0fac880e0e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8949ea8b-a66a-4c3d-a048-3020e3d8b7f9", "tag": "c3bb5511-a235-4369-a160-73fb0904cf14"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:25.408819 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-5c97ee00-538d-4956-9f98-1892e266928a req-824a4032-2996-41a8-9e59-0fac880e0e33 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:25.409258 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-5c97ee00-538d-4956-9f98-1892e266928a req-824a4032-2996-41a8-9e59-0fac880e0e33 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:25.414370 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7ac74fb8-d148-4fac-b3a0-d40b6283514c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:25.422235 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-5c97ee00-538d-4956-9f98-1892e266928a req-824a4032-2996-41a8-9e59-0fac880e0e33 service nova] Creating event network-changed:c3bb5511-a235-4369-a160-73fb0904cf14 for instance 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 on hv-cinder-83607 May 26 17:05:25.427608 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7ac74fb8-d148-4fac-b3a0-d40b6283514c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.274618 May 26 17:05:25.430968 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-5c97ee00-538d-4956-9f98-1892e266928a req-824a4032-2996-41a8-9e59-0fac880e0e33 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037747 May 26 17:05:25.432113 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 400/777] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:05:25.432833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 378/778] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:25 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:25.592608 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-624f0ffb-0d21-4e26-8e14-d26fafab24f2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:25.593313 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-624f0ffb-0d21-4e26-8e14-d26fafab24f2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:25.599917 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-624f0ffb-0d21-4e26-8e14-d26fafab24f2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:25.600312 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-624f0ffb-0d21-4e26-8e14-d26fafab24f2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:25.601081 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-624f0ffb-0d21-4e26-8e14-d26fafab24f2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:25.601513 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-624f0ffb-0d21-4e26-8e14-d26fafab24f2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:25.753135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-624f0ffb-0d21-4e26-8e14-d26fafab24f2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:25.761313 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-624f0ffb-0d21-4e26-8e14-d26fafab24f2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1281 microversion: 2.1 time: 0.174291 May 26 17:05:25.761926 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 401/779] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:25 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:26.082686 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d2fd4279-bdc4-4b1a-89b5-f663630561a5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:26.083500 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d2fd4279-bdc4-4b1a-89b5-f663630561a5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:26.089853 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d2fd4279-bdc4-4b1a-89b5-f663630561a5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:26.090387 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d2fd4279-bdc4-4b1a-89b5-f663630561a5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:26.091653 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d2fd4279-bdc4-4b1a-89b5-f663630561a5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:26.092180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d2fd4279-bdc4-4b1a-89b5-f663630561a5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:26.425100 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d2fd4279-bdc4-4b1a-89b5-f663630561a5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:26.426532 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d2fd4279-bdc4-4b1a-89b5-f663630561a5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.348157 May 26 17:05:26.427113 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 379/780] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:26 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:26.444741 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-484cfa91-24f7-4c12-8455-b1752f79146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:26.445380 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-484cfa91-24f7-4c12-8455-b1752f79146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:26.451435 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-484cfa91-24f7-4c12-8455-b1752f79146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:26.451873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-484cfa91-24f7-4c12-8455-b1752f79146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:26.452622 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-484cfa91-24f7-4c12-8455-b1752f79146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:26.453047 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-484cfa91-24f7-4c12-8455-b1752f79146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:26.589663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-484cfa91-24f7-4c12-8455-b1752f79146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:26.601422 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-484cfa91-24f7-4c12-8455-b1752f79146c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.158552 May 26 17:05:26.602379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 402/781] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:26 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:26.780935 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fd5f8565-54da-4041-b118-1d4cf175a6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:26.781462 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fd5f8565-54da-4041-b118-1d4cf175a6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:26.788275 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd5f8565-54da-4041-b118-1d4cf175a6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:26.788725 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd5f8565-54da-4041-b118-1d4cf175a6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:26.789505 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd5f8565-54da-4041-b118-1d4cf175a6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:26.789926 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd5f8565-54da-4041-b118-1d4cf175a6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:26.961781 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fd5f8565-54da-4041-b118-1d4cf175a6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:26.970611 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fd5f8565-54da-4041-b118-1d4cf175a6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.194625 May 26 17:05:26.971184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 380/782] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:26 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:27.443810 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a2d166c5-6578-43d0-aeba-791e0875c2fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:27.444426 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a2d166c5-6578-43d0-aeba-791e0875c2fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:27.451638 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a2d166c5-6578-43d0-aeba-791e0875c2fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:27.452227 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a2d166c5-6578-43d0-aeba-791e0875c2fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:27.452779 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a2d166c5-6578-43d0-aeba-791e0875c2fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:27.453217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a2d166c5-6578-43d0-aeba-791e0875c2fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:27.584056 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a2d166c5-6578-43d0-aeba-791e0875c2fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:27.592078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a2d166c5-6578-43d0-aeba-791e0875c2fd tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.152090 May 26 17:05:27.592663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 403/783] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:27 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:27.619760 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d64e8ff9-6c42-4fae-a239-2072864bb583 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:27.620377 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d64e8ff9-6c42-4fae-a239-2072864bb583 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:27.628284 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d64e8ff9-6c42-4fae-a239-2072864bb583 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:27.628731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d64e8ff9-6c42-4fae-a239-2072864bb583 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:27.633914 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d64e8ff9-6c42-4fae-a239-2072864bb583 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:27.634515 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d64e8ff9-6c42-4fae-a239-2072864bb583 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:27.766114 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d64e8ff9-6c42-4fae-a239-2072864bb583 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:27.774035 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d64e8ff9-6c42-4fae-a239-2072864bb583 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.158127 May 26 17:05:27.774631 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 381/784] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:27 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:27.988265 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-37ce7a54-1b38-499b-a029-97e80671eb5a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:27.988788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-37ce7a54-1b38-499b-a029-97e80671eb5a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:27.994783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-37ce7a54-1b38-499b-a029-97e80671eb5a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:27.995278 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-37ce7a54-1b38-499b-a029-97e80671eb5a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:27.996023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-37ce7a54-1b38-499b-a029-97e80671eb5a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:27.996987 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-37ce7a54-1b38-499b-a029-97e80671eb5a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:28.128184 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-37ce7a54-1b38-499b-a029-97e80671eb5a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:28.135847 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-37ce7a54-1b38-499b-a029-97e80671eb5a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.151461 May 26 17:05:28.136417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 404/785] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:27 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:28.610261 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-310deb24-958c-468f-a939-ca440dfb9a95 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:28.610907 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-310deb24-958c-468f-a939-ca440dfb9a95 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:28.617744 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-310deb24-958c-468f-a939-ca440dfb9a95 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:28.618230 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-310deb24-958c-468f-a939-ca440dfb9a95 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:28.619053 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-310deb24-958c-468f-a939-ca440dfb9a95 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:28.619491 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-310deb24-958c-468f-a939-ca440dfb9a95 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:28.751823 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-310deb24-958c-468f-a939-ca440dfb9a95 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:28.759298 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-310deb24-958c-468f-a939-ca440dfb9a95 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.153732 May 26 17:05:28.759854 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 382/786] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:28 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:28.791405 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-47e801a6-6f12-42d6-b6dc-adc3a1aa9279 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:28.792133 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-47e801a6-6f12-42d6-b6dc-adc3a1aa9279 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:28.798953 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-47e801a6-6f12-42d6-b6dc-adc3a1aa9279 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:28.799426 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-47e801a6-6f12-42d6-b6dc-adc3a1aa9279 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:28.800194 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-47e801a6-6f12-42d6-b6dc-adc3a1aa9279 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:28.800624 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-47e801a6-6f12-42d6-b6dc-adc3a1aa9279 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:28.915830 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-15caeb9f-7bc5-4c71-ad8d-01fb575b02db tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:28.916455 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-15caeb9f-7bc5-4c71-ad8d-01fb575b02db tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:28.922756 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-15caeb9f-7bc5-4c71-ad8d-01fb575b02db tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:28.923328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-15caeb9f-7bc5-4c71-ad8d-01fb575b02db tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:28.924119 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-15caeb9f-7bc5-4c71-ad8d-01fb575b02db tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:28.924563 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-15caeb9f-7bc5-4c71-ad8d-01fb575b02db tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:28.934636 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-47e801a6-6f12-42d6-b6dc-adc3a1aa9279 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:28.942532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-47e801a6-6f12-42d6-b6dc-adc3a1aa9279 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.154992 May 26 17:05:28.943105 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 405/787] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:28 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:28.947952 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-15caeb9f-7bc5-4c71-ad8d-01fb575b02db tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8/ips" status: 200 len: 149 microversion: 2.1 time: 0.036183 May 26 17:05:28.948520 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 383/788] 10.222.0.112 () {58 vars in 1252 bytes} [Thu May 26 17:05:28 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:28.960222 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-626535da-3f8b-4508-99bd-2e72252afeba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86f46ceb-ae94-4737-b499-2a352dcad793"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:28.961358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-626535da-3f8b-4508-99bd-2e72252afeba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:28.967600 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-626535da-3f8b-4508-99bd-2e72252afeba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:28.968051 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-626535da-3f8b-4508-99bd-2e72252afeba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:28.968810 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-626535da-3f8b-4508-99bd-2e72252afeba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:28.969248 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-626535da-3f8b-4508-99bd-2e72252afeba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:29.049359 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-626535da-3f8b-4508-99bd-2e72252afeba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Invalid volume: volume 86f46ceb-ae94-4737-b499-2a352dcad793 is already attached to instances: 60352cdb-28fe-49a5-85e8-ae2c9c92b184 May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-626535da-3f8b-4508-99bd-2e72252afeba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: POST /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8/os-volume_attachments HTTP/1.1 May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 74 May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:05:29.051183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:05:29.052778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:05:29.052778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:05:29.052778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:05:29.052778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:05:29.052778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:05:29.052778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:05:29.052778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:05:29.052778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:05:29.052778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:05:29.052778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: May 26 17:05:29.052778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {"volumeAttachment": {"volumeId": "86f46ceb-ae94-4737-b499-2a352dcad793"}} May 26 17:05:29.052778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Invalid volume: volume 86f46ceb-ae94-4737-b499-2a352dcad793 is already attached to instances: 60352cdb-28fe-49a5-85e8-ae2c9c92b184 May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'server_id': '1248649c-ce32-42fd-8764-3a985faf06b8', 'body': {'volumeAttachment': {'volumeId': '86f46ceb-ae94-4737-b499-2a352dcad793'}}} May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 86f46ceb-ae94-4737-b499-2a352dcad793 is already attached to instances: 60352cdb-28fe-49a5-85e8-ae2c9c92b184 May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:29.053690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 86f46ceb-ae94-4737-b499-2a352dcad793 is already attached to instances: 60352cdb-28fe-49a5-85e8-ae2c9c92b184 May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:29.055090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:29.056511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:29.056511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:05:29.056511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:05:29.056511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 86f46ceb-ae94-4737-b499-2a352dcad793 is already attached to instances: 60352cdb-28fe-49a5-85e8-ae2c9c92b184 May 26 17:05:29.056511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:29.056511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-626535da-3f8b-4508-99bd-2e72252afeba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 400 to user: Invalid volume: volume 86f46ceb-ae94-4737-b499-2a352dcad793 is already attached to instances: 60352cdb-28fe-49a5-85e8-ae2c9c92b184 {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:05:29.056511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-626535da-3f8b-4508-99bd-2e72252afeba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096273 May 26 17:05:29.056511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 406/789] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:05:28 2022] POST /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 17:05:29.062097 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ab0a443e-32ed-49ae-96c9-fb564ce02779 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:29.062773 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ab0a443e-32ed-49ae-96c9-fb564ce02779 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:29.068897 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab0a443e-32ed-49ae-96c9-fb564ce02779 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:29.069393 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab0a443e-32ed-49ae-96c9-fb564ce02779 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:29.070212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab0a443e-32ed-49ae-96c9-fb564ce02779 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:29.070682 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab0a443e-32ed-49ae-96c9-fb564ce02779 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:29.096164 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ab0a443e-32ed-49ae-96c9-fb564ce02779 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Going to try to terminate instance {{(pid=130525) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:05:29.154237 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0dea4eb8-9c8f-4bf6-bc04-24b44757e8a2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:29.154909 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0dea4eb8-9c8f-4bf6-bc04-24b44757e8a2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:29.160996 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0dea4eb8-9c8f-4bf6-bc04-24b44757e8a2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:29.161443 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0dea4eb8-9c8f-4bf6-bc04-24b44757e8a2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:29.162201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0dea4eb8-9c8f-4bf6-bc04-24b44757e8a2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:29.162666 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0dea4eb8-9c8f-4bf6-bc04-24b44757e8a2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:29.271844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:29.291947 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0dea4eb8-9c8f-4bf6-bc04-24b44757e8a2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:29.294728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=6 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:29.301399 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0dea4eb8-9c8f-4bf6-bc04-24b44757e8a2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.150958 May 26 17:05:29.302237 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 407/790] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:29 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:29.410849 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ab0a443e-32ed-49ae-96c9-fb564ce02779 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 204 len: 0 microversion: 2.1 time: 0.352658 May 26 17:05:29.411372 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 384/791] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:05:29 2022] DELETE /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:05:29.421008 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f7698751-f82a-4056-a69c-b95fed36648a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:29.431281 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f7698751-f82a-4056-a69c-b95fed36648a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:29.431281 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f7698751-f82a-4056-a69c-b95fed36648a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:29.431281 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f7698751-f82a-4056-a69c-b95fed36648a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:29.431281 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f7698751-f82a-4056-a69c-b95fed36648a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:29.431692 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f7698751-f82a-4056-a69c-b95fed36648a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:29.565263 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f7698751-f82a-4056-a69c-b95fed36648a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:29.572954 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f7698751-f82a-4056-a69c-b95fed36648a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1684 microversion: 2.1 time: 0.157209 May 26 17:05:29.573513 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 408/792] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:29 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:29.778530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3bbdb5db-1347-4e76-9059-37e419fc7ac1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:29.779142 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3bbdb5db-1347-4e76-9059-37e419fc7ac1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:29.785627 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3bbdb5db-1347-4e76-9059-37e419fc7ac1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:29.786066 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3bbdb5db-1347-4e76-9059-37e419fc7ac1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:29.786861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3bbdb5db-1347-4e76-9059-37e419fc7ac1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:29.787291 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3bbdb5db-1347-4e76-9059-37e419fc7ac1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:29.920492 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3bbdb5db-1347-4e76-9059-37e419fc7ac1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:29.928028 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3bbdb5db-1347-4e76-9059-37e419fc7ac1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.154356 May 26 17:05:29.928604 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 385/793] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:29 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:29.960009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-cc2c3e51-6e72-49ff-8851-aef7f53e72b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:29.960612 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-cc2c3e51-6e72-49ff-8851-aef7f53e72b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:29.967957 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cc2c3e51-6e72-49ff-8851-aef7f53e72b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:29.968403 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cc2c3e51-6e72-49ff-8851-aef7f53e72b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:29.969158 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cc2c3e51-6e72-49ff-8851-aef7f53e72b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:29.969589 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cc2c3e51-6e72-49ff-8851-aef7f53e72b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:30.102295 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cc2c3e51-6e72-49ff-8851-aef7f53e72b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:30.110396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-cc2c3e51-6e72-49ff-8851-aef7f53e72b5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.154104 May 26 17:05:30.110999 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 409/794] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:29 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:30.318797 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a267575c-d27b-48cc-aef4-80acaabf51e7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:30.319356 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a267575c-d27b-48cc-aef4-80acaabf51e7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:30.321274 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:30.326424 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a267575c-d27b-48cc-aef4-80acaabf51e7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:30.326885 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a267575c-d27b-48cc-aef4-80acaabf51e7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:30.332922 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a267575c-d27b-48cc-aef4-80acaabf51e7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:30.332922 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a267575c-d27b-48cc-aef4-80acaabf51e7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:30.458233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a267575c-d27b-48cc-aef4-80acaabf51e7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:30.466445 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a267575c-d27b-48cc-aef4-80acaabf51e7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.151784 May 26 17:05:30.467012 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 386/795] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:30 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:30.591589 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5582a9aa-fb76-4912-a349-730558992b69 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:30.592196 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5582a9aa-fb76-4912-a349-730558992b69 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:30.598222 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5582a9aa-fb76-4912-a349-730558992b69 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:30.598690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5582a9aa-fb76-4912-a349-730558992b69 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:30.599447 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5582a9aa-fb76-4912-a349-730558992b69 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:30.599876 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5582a9aa-fb76-4912-a349-730558992b69 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:30.732319 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5582a9aa-fb76-4912-a349-730558992b69 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:30.739889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5582a9aa-fb76-4912-a349-730558992b69 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1684 microversion: 2.1 time: 0.152469 May 26 17:05:30.740457 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 410/796] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:30 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:30.946194 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f4198cb6-d9c4-480d-91cd-3ce5b3ff9659 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:30.946858 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f4198cb6-d9c4-480d-91cd-3ce5b3ff9659 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:30.953962 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f4198cb6-d9c4-480d-91cd-3ce5b3ff9659 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:30.954453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f4198cb6-d9c4-480d-91cd-3ce5b3ff9659 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:30.955488 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f4198cb6-d9c4-480d-91cd-3ce5b3ff9659 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:30.955924 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f4198cb6-d9c4-480d-91cd-3ce5b3ff9659 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:31.089218 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f4198cb6-d9c4-480d-91cd-3ce5b3ff9659 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:31.096557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f4198cb6-d9c4-480d-91cd-3ce5b3ff9659 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1682 microversion: 2.1 time: 0.154274 May 26 17:05:31.097111 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 387/797] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:30 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:31.127142 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ac517c3e-f134-43e8-ad79-ca478e5413bf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:31.127754 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ac517c3e-f134-43e8-ad79-ca478e5413bf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:31.134147 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ac517c3e-f134-43e8-ad79-ca478e5413bf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:31.134625 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ac517c3e-f134-43e8-ad79-ca478e5413bf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:31.135389 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ac517c3e-f134-43e8-ad79-ca478e5413bf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:31.135825 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ac517c3e-f134-43e8-ad79-ca478e5413bf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:31.267872 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ac517c3e-f134-43e8-ad79-ca478e5413bf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:31.275825 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ac517c3e-f134-43e8-ad79-ca478e5413bf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.152524 May 26 17:05:31.276383 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 411/798] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:31 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:31.483057 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-62adc0fb-063f-4277-b752-1786d22de8c0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:31.483588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-62adc0fb-063f-4277-b752-1786d22de8c0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:31.489655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-62adc0fb-063f-4277-b752-1786d22de8c0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:31.490092 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-62adc0fb-063f-4277-b752-1786d22de8c0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:31.490908 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-62adc0fb-063f-4277-b752-1786d22de8c0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:31.491392 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-62adc0fb-063f-4277-b752-1786d22de8c0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:31.628259 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-62adc0fb-063f-4277-b752-1786d22de8c0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:31.635877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-62adc0fb-063f-4277-b752-1786d22de8c0 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.157408 May 26 17:05:31.636556 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 388/799] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:31 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:31.757798 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-48b6f70a-2fc4-4c2c-a450-68f07cf10a25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:31.758359 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-48b6f70a-2fc4-4c2c-a450-68f07cf10a25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:31.764567 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48b6f70a-2fc4-4c2c-a450-68f07cf10a25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:31.765017 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48b6f70a-2fc4-4c2c-a450-68f07cf10a25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:31.766570 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48b6f70a-2fc4-4c2c-a450-68f07cf10a25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:31.767044 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48b6f70a-2fc4-4c2c-a450-68f07cf10a25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:31.900562 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-48b6f70a-2fc4-4c2c-a450-68f07cf10a25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:31.909739 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-48b6f70a-2fc4-4c2c-a450-68f07cf10a25 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1684 microversion: 2.1 time: 0.155854 May 26 17:05:31.910337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 412/800] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:31 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:32.114201 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6b49ad7a-0f24-4ea5-8ac8-e2f0cdf37bf5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:32.114944 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6b49ad7a-0f24-4ea5-8ac8-e2f0cdf37bf5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:32.122839 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6b49ad7a-0f24-4ea5-8ac8-e2f0cdf37bf5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:32.123288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6b49ad7a-0f24-4ea5-8ac8-e2f0cdf37bf5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:32.124051 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6b49ad7a-0f24-4ea5-8ac8-e2f0cdf37bf5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:32.124482 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6b49ad7a-0f24-4ea5-8ac8-e2f0cdf37bf5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:32.262257 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6b49ad7a-0f24-4ea5-8ac8-e2f0cdf37bf5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:32.271126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6b49ad7a-0f24-4ea5-8ac8-e2f0cdf37bf5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1659 microversion: 2.1 time: 0.161745 May 26 17:05:32.271747 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 389/801] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:32 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1659 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:32.288956 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8dbef7d1-6344-4d6a-ba8a-9509d9bc457a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:32.293618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cbeb4520-deb2-40c5-81d5-e5ecb4e8f111 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:32.294787 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cbeb4520-deb2-40c5-81d5-e5ecb4e8f111 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:32.295905 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8dbef7d1-6344-4d6a-ba8a-9509d9bc457a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:32.296368 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8dbef7d1-6344-4d6a-ba8a-9509d9bc457a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:32.301553 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cbeb4520-deb2-40c5-81d5-e5ecb4e8f111 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:32.302041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cbeb4520-deb2-40c5-81d5-e5ecb4e8f111 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:32.302985 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cbeb4520-deb2-40c5-81d5-e5ecb4e8f111 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:32.303466 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cbeb4520-deb2-40c5-81d5-e5ecb4e8f111 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:32.319079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8dbef7d1-6344-4d6a-ba8a-9509d9bc457a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Going to try to start instance {{(pid=130526) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 17:05:32.447285 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cbeb4520-deb2-40c5-81d5-e5ecb4e8f111 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:32.456706 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cbeb4520-deb2-40c5-81d5-e5ecb4e8f111 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.167911 May 26 17:05:32.457280 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 390/802] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:32 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:32.541989 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8dbef7d1-6344-4d6a-ba8a-9509d9bc457a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "POST /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/action" status: 202 len: 0 microversion: 2.1 time: 0.256763 May 26 17:05:32.542655 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 413/803] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:05:32 2022] POST /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:05:32.550955 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f3a62579-cfbe-4f7f-a13d-ba3dadb0ba12 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:32.551570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f3a62579-cfbe-4f7f-a13d-ba3dadb0ba12 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:32.557742 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f3a62579-cfbe-4f7f-a13d-ba3dadb0ba12 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:32.558190 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f3a62579-cfbe-4f7f-a13d-ba3dadb0ba12 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:32.560100 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f3a62579-cfbe-4f7f-a13d-ba3dadb0ba12 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:32.560542 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f3a62579-cfbe-4f7f-a13d-ba3dadb0ba12 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:32.579888 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:32.655513 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1e5b1f1e-c7ea-4a81-bf02-363ace2ee42b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:32.656320 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1e5b1f1e-c7ea-4a81-bf02-363ace2ee42b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:32.662931 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1e5b1f1e-c7ea-4a81-bf02-363ace2ee42b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:32.663223 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1e5b1f1e-c7ea-4a81-bf02-363ace2ee42b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:32.664100 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1e5b1f1e-c7ea-4a81-bf02-363ace2ee42b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:32.664485 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1e5b1f1e-c7ea-4a81-bf02-363ace2ee42b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:32.706738 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f3a62579-cfbe-4f7f-a13d-ba3dadb0ba12 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:32.716182 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f3a62579-cfbe-4f7f-a13d-ba3dadb0ba12 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1668 microversion: 2.1 time: 0.169025 May 26 17:05:32.717063 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 391/804] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:32 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:32.811670 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1e5b1f1e-c7ea-4a81-bf02-363ace2ee42b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:32.819747 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1e5b1f1e-c7ea-4a81-bf02-363ace2ee42b tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.168564 May 26 17:05:32.820350 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 414/805] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:32 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:32.928643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-397ba3ae-5283-4273-b200-a99408f05006 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:32.929164 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-397ba3ae-5283-4273-b200-a99408f05006 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:32.936635 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-397ba3ae-5283-4273-b200-a99408f05006 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:32.937093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-397ba3ae-5283-4273-b200-a99408f05006 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:32.937855 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-397ba3ae-5283-4273-b200-a99408f05006 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:32.938284 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-397ba3ae-5283-4273-b200-a99408f05006 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:33.281366 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-397ba3ae-5283-4273-b200-a99408f05006 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:33.289781 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-397ba3ae-5283-4273-b200-a99408f05006 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1684 microversion: 2.1 time: 0.364965 May 26 17:05:33.290390 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 392/806] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:32 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1684 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:33.475714 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0d495ecd-8c8f-4ce2-8fc0-47ba28a751bd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:33.476619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0d495ecd-8c8f-4ce2-8fc0-47ba28a751bd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:33.485086 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0d495ecd-8c8f-4ce2-8fc0-47ba28a751bd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:33.485539 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0d495ecd-8c8f-4ce2-8fc0-47ba28a751bd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:33.486462 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0d495ecd-8c8f-4ce2-8fc0-47ba28a751bd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:33.486901 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0d495ecd-8c8f-4ce2-8fc0-47ba28a751bd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:33.629293 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0d495ecd-8c8f-4ce2-8fc0-47ba28a751bd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:33.639364 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0d495ecd-8c8f-4ce2-8fc0-47ba28a751bd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.168203 May 26 17:05:33.646079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 415/807] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:33 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:33.736834 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3922fb54-199f-4e50-a425-8fd48a2e768d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:33.737312 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3922fb54-199f-4e50-a425-8fd48a2e768d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:33.744872 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3922fb54-199f-4e50-a425-8fd48a2e768d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:33.745414 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3922fb54-199f-4e50-a425-8fd48a2e768d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:33.747468 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3922fb54-199f-4e50-a425-8fd48a2e768d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:33.748288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3922fb54-199f-4e50-a425-8fd48a2e768d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:33.837494 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8a32fde6-6415-4b12-93ec-e2dc113df6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:33.838116 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8a32fde6-6415-4b12-93ec-e2dc113df6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:33.845069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8a32fde6-6415-4b12-93ec-e2dc113df6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:33.845519 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8a32fde6-6415-4b12-93ec-e2dc113df6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:33.846302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8a32fde6-6415-4b12-93ec-e2dc113df6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:33.846762 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8a32fde6-6415-4b12-93ec-e2dc113df6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:33.851349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:34.031834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8a32fde6-6415-4b12-93ec-e2dc113df6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:34.031834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8a32fde6-6415-4b12-93ec-e2dc113df6fb tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.164297 May 26 17:05:34.031834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 416/808] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:33 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:34.164268 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3922fb54-199f-4e50-a425-8fd48a2e768d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:34.172834 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3922fb54-199f-4e50-a425-8fd48a2e768d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1668 microversion: 2.1 time: 0.440197 May 26 17:05:34.173413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 393/809] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:33 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1668 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:34.268881 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-799fc7f9-2f21-4d2b-8a36-42c825d1cc40 req-d84cc7c9-80ce-4e80-b7d9-b59250464475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1248649c-ce32-42fd-8764-3a985faf06b8", "name": "network-vif-deleted", "tag": "55e9f2ec-9d77-41f0-9a91-f494d6cec330"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:34.277481 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-799fc7f9-2f21-4d2b-8a36-42c825d1cc40 req-d84cc7c9-80ce-4e80-b7d9-b59250464475 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:34.278127 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-799fc7f9-2f21-4d2b-8a36-42c825d1cc40 req-d84cc7c9-80ce-4e80-b7d9-b59250464475 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:34.289837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-799fc7f9-2f21-4d2b-8a36-42c825d1cc40 req-d84cc7c9-80ce-4e80-b7d9-b59250464475 service nova] Creating event network-vif-deleted:55e9f2ec-9d77-41f0-9a91-f494d6cec330 for instance 1248649c-ce32-42fd-8764-3a985faf06b8 on hv-cinder-83607 May 26 17:05:34.295590 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-799fc7f9-2f21-4d2b-8a36-42c825d1cc40 req-d84cc7c9-80ce-4e80-b7d9-b59250464475 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030290 May 26 17:05:34.296190 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 417/810] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:34.308243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e0c0498d-d09b-41c4-baaf-482bb07be83e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:34.309562 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e0c0498d-d09b-41c4-baaf-482bb07be83e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:34.315722 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e0c0498d-d09b-41c4-baaf-482bb07be83e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:34.316167 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e0c0498d-d09b-41c4-baaf-482bb07be83e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:34.317011 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e0c0498d-d09b-41c4-baaf-482bb07be83e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:34.317485 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e0c0498d-d09b-41c4-baaf-482bb07be83e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:34.385098 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e0c0498d-d09b-41c4-baaf-482bb07be83e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:34.393340 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e0c0498d-d09b-41c4-baaf-482bb07be83e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1617 microversion: 2.1 time: 0.088907 May 26 17:05:34.393936 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 394/811] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:34 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1617 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:34.658780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f3f5396e-b117-41d2-9692-5765593b20c8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:34.659571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f3f5396e-b117-41d2-9692-5765593b20c8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:34.667280 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f3f5396e-b117-41d2-9692-5765593b20c8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:34.668262 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f3f5396e-b117-41d2-9692-5765593b20c8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:34.669641 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f3f5396e-b117-41d2-9692-5765593b20c8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:34.670078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f3f5396e-b117-41d2-9692-5765593b20c8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:34.807329 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f3f5396e-b117-41d2-9692-5765593b20c8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:34.815305 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f3f5396e-b117-41d2-9692-5765593b20c8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.161469 May 26 17:05:34.815902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 418/812] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:34 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:35.016959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a6abbe80-b093-495a-add2-0d28a3b5d1fa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:35.017578 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a6abbe80-b093-495a-add2-0d28a3b5d1fa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:35.024573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a6abbe80-b093-495a-add2-0d28a3b5d1fa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:35.025037 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a6abbe80-b093-495a-add2-0d28a3b5d1fa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:35.025882 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a6abbe80-b093-495a-add2-0d28a3b5d1fa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:35.026340 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a6abbe80-b093-495a-add2-0d28a3b5d1fa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:35.163778 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a6abbe80-b093-495a-add2-0d28a3b5d1fa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:35.172009 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a6abbe80-b093-495a-add2-0d28a3b5d1fa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.160211 May 26 17:05:35.172584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 395/813] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:35 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:35.190579 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-420bf408-97aa-4a92-87c5-b76f652dbba5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:35.191190 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-420bf408-97aa-4a92-87c5-b76f652dbba5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:35.197099 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-420bf408-97aa-4a92-87c5-b76f652dbba5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:35.197544 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-420bf408-97aa-4a92-87c5-b76f652dbba5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:35.198304 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-420bf408-97aa-4a92-87c5-b76f652dbba5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:35.198751 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-420bf408-97aa-4a92-87c5-b76f652dbba5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:35.328190 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-420bf408-97aa-4a92-87c5-b76f652dbba5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:35.336057 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-420bf408-97aa-4a92-87c5-b76f652dbba5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1668 microversion: 2.1 time: 0.149298 May 26 17:05:35.336621 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 419/814] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:35 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:35.411051 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-04b7c9d8-b7fe-4bc6-9a9c-11faa6f645d6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:35.411666 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-04b7c9d8-b7fe-4bc6-9a9c-11faa6f645d6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:35.417648 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-04b7c9d8-b7fe-4bc6-9a9c-11faa6f645d6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:35.418731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-04b7c9d8-b7fe-4bc6-9a9c-11faa6f645d6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:35.419506 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-04b7c9d8-b7fe-4bc6-9a9c-11faa6f645d6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:35.419944 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-04b7c9d8-b7fe-4bc6-9a9c-11faa6f645d6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:35.481373 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-04b7c9d8-b7fe-4bc6-9a9c-11faa6f645d6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:35.488874 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-04b7c9d8-b7fe-4bc6-9a9c-11faa6f645d6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1617 microversion: 2.1 time: 0.081747 May 26 17:05:35.489429 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 396/815] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:35 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1617 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:35.832667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-379deeb6-fdaa-4d1a-baec-f05084afc68e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:35.833214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-379deeb6-fdaa-4d1a-baec-f05084afc68e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:35.839892 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-379deeb6-fdaa-4d1a-baec-f05084afc68e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:35.840344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-379deeb6-fdaa-4d1a-baec-f05084afc68e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:35.841126 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-379deeb6-fdaa-4d1a-baec-f05084afc68e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:35.841562 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-379deeb6-fdaa-4d1a-baec-f05084afc68e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:35.982832 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-379deeb6-fdaa-4d1a-baec-f05084afc68e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:35.992163 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-379deeb6-fdaa-4d1a-baec-f05084afc68e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.163639 May 26 17:05:35.992662 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 420/816] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:35 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:36.188982 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-862b7c5e-7804-4dfa-b7a8-10330ae5be7d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:36.189611 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-862b7c5e-7804-4dfa-b7a8-10330ae5be7d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:36.196080 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-862b7c5e-7804-4dfa-b7a8-10330ae5be7d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:36.196533 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-862b7c5e-7804-4dfa-b7a8-10330ae5be7d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:36.197322 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-862b7c5e-7804-4dfa-b7a8-10330ae5be7d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:36.197752 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-862b7c5e-7804-4dfa-b7a8-10330ae5be7d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:36.354051 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ddfd2403-3ede-48d4-9506-4a2330eb31bc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:36.354712 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ddfd2403-3ede-48d4-9506-4a2330eb31bc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:36.361757 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ddfd2403-3ede-48d4-9506-4a2330eb31bc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:36.362197 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ddfd2403-3ede-48d4-9506-4a2330eb31bc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:36.362993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ddfd2403-3ede-48d4-9506-4a2330eb31bc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:36.363417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ddfd2403-3ede-48d4-9506-4a2330eb31bc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:36.366840 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-862b7c5e-7804-4dfa-b7a8-10330ae5be7d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:36.375202 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-862b7c5e-7804-4dfa-b7a8-10330ae5be7d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.190095 May 26 17:05:36.375781 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 397/817] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:36 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:36.491503 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ddfd2403-3ede-48d4-9506-4a2330eb31bc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:36.499658 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ddfd2403-3ede-48d4-9506-4a2330eb31bc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1668 microversion: 2.1 time: 0.149531 May 26 17:05:36.500227 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 421/818] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:36 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:36.506644 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c71bd3cc-9e91-4b88-a5bb-d45dc4ba674f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:36.507247 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c71bd3cc-9e91-4b88-a5bb-d45dc4ba674f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:36.513958 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c71bd3cc-9e91-4b88-a5bb-d45dc4ba674f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:36.514435 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c71bd3cc-9e91-4b88-a5bb-d45dc4ba674f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:36.515212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c71bd3cc-9e91-4b88-a5bb-d45dc4ba674f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:36.515652 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c71bd3cc-9e91-4b88-a5bb-d45dc4ba674f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:36.545524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c71bd3cc-9e91-4b88-a5bb-d45dc4ba674f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:36.545971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c71bd3cc-9e91-4b88-a5bb-d45dc4ba674f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:36.546448 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-c71bd3cc-9e91-4b88-a5bb-d45dc4ba674f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lazy-loading 'fault' on Instance uuid 1248649c-ce32-42fd-8764-3a985faf06b8 {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:05:36.587564 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c71bd3cc-9e91-4b88-a5bb-d45dc4ba674f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:36.595148 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c71bd3cc-9e91-4b88-a5bb-d45dc4ba674f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1335 microversion: 2.1 time: 0.092352 May 26 17:05:36.595719 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 398/819] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:36 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1335 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:37.012654 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3c1d1e6f-4b35-424a-a19d-be89fed56722 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:37.014009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3c1d1e6f-4b35-424a-a19d-be89fed56722 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:37.022129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3c1d1e6f-4b35-424a-a19d-be89fed56722 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:37.023024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3c1d1e6f-4b35-424a-a19d-be89fed56722 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:37.024022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3c1d1e6f-4b35-424a-a19d-be89fed56722 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:37.024651 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3c1d1e6f-4b35-424a-a19d-be89fed56722 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:37.183429 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3c1d1e6f-4b35-424a-a19d-be89fed56722 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:37.193485 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3c1d1e6f-4b35-424a-a19d-be89fed56722 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.187693 May 26 17:05:37.203631 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 422/820] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:37 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:37.393466 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e389c938-4fc8-41be-a541-b1110d0a93df tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:37.394077 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e389c938-4fc8-41be-a541-b1110d0a93df tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:37.401510 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e389c938-4fc8-41be-a541-b1110d0a93df tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:37.402091 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e389c938-4fc8-41be-a541-b1110d0a93df tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:37.404163 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e389c938-4fc8-41be-a541-b1110d0a93df tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:37.405021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e389c938-4fc8-41be-a541-b1110d0a93df tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:37.517437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5c820b0b-7646-4faf-bdce-068338f43999 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:37.518222 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5c820b0b-7646-4faf-bdce-068338f43999 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:37.525515 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c820b0b-7646-4faf-bdce-068338f43999 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:37.526068 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c820b0b-7646-4faf-bdce-068338f43999 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:37.527087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c820b0b-7646-4faf-bdce-068338f43999 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:37.528190 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c820b0b-7646-4faf-bdce-068338f43999 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:37.546023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e389c938-4fc8-41be-a541-b1110d0a93df tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:37.553676 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e389c938-4fc8-41be-a541-b1110d0a93df tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.164170 May 26 17:05:37.554266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 399/821] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:37 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:37.613015 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2e3bdb74-acbc-45b6-8a6a-fbaac5029e13 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:37.613636 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-2e3bdb74-acbc-45b6-8a6a-fbaac5029e13 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:37.619790 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2e3bdb74-acbc-45b6-8a6a-fbaac5029e13 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:37.620247 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2e3bdb74-acbc-45b6-8a6a-fbaac5029e13 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:37.621240 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2e3bdb74-acbc-45b6-8a6a-fbaac5029e13 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:37.621873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2e3bdb74-acbc-45b6-8a6a-fbaac5029e13 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:37.649503 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:37.653763 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2e3bdb74-acbc-45b6-8a6a-fbaac5029e13 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:37.654221 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2e3bdb74-acbc-45b6-8a6a-fbaac5029e13 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:37.654706 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-2e3bdb74-acbc-45b6-8a6a-fbaac5029e13 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lazy-loading 'fault' on Instance uuid 1248649c-ce32-42fd-8764-3a985faf06b8 {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:05:37.667524 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5c820b0b-7646-4faf-bdce-068338f43999 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:37.676867 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5c820b0b-7646-4faf-bdce-068338f43999 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1672 microversion: 2.1 time: 0.163683 May 26 17:05:37.677295 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 423/822] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:37 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:37.700471 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2e3bdb74-acbc-45b6-8a6a-fbaac5029e13 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:37.708877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-2e3bdb74-acbc-45b6-8a6a-fbaac5029e13 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 200 len: 1335 microversion: 2.1 time: 0.100088 May 26 17:05:37.709447 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 400/823] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:37 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 1335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:38.210654 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0ccd39ac-52b9-4cdf-a755-7358157db8e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:38.215594 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0ccd39ac-52b9-4cdf-a755-7358157db8e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:38.232098 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0ccd39ac-52b9-4cdf-a755-7358157db8e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:38.233153 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0ccd39ac-52b9-4cdf-a755-7358157db8e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:38.236666 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0ccd39ac-52b9-4cdf-a755-7358157db8e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:38.237421 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0ccd39ac-52b9-4cdf-a755-7358157db8e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:38.380423 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0ccd39ac-52b9-4cdf-a755-7358157db8e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:38.388451 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0ccd39ac-52b9-4cdf-a755-7358157db8e5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.181479 May 26 17:05:38.389013 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 424/824] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:38 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:38.569770 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-acd590c7-d9d8-4e29-a0b5-4999442dc876 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:38.570305 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-acd590c7-d9d8-4e29-a0b5-4999442dc876 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:38.577160 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-acd590c7-d9d8-4e29-a0b5-4999442dc876 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:38.577609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-acd590c7-d9d8-4e29-a0b5-4999442dc876 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:38.578397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-acd590c7-d9d8-4e29-a0b5-4999442dc876 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:38.578832 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-acd590c7-d9d8-4e29-a0b5-4999442dc876 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:38.713863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-acd590c7-d9d8-4e29-a0b5-4999442dc876 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:38.721514 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-acd590c7-d9d8-4e29-a0b5-4999442dc876 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.155706 May 26 17:05:38.726907 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 401/825] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:38 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:38.732384 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a5c1859e-df4b-49f4-9861-7605aee06887 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:38.733037 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a5c1859e-df4b-49f4-9861-7605aee06887 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:38.739140 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a5c1859e-df4b-49f4-9861-7605aee06887 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:38.739583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a5c1859e-df4b-49f4-9861-7605aee06887 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:38.740359 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a5c1859e-df4b-49f4-9861-7605aee06887 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:38.740783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a5c1859e-df4b-49f4-9861-7605aee06887 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:38.755453 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-a5c1859e-df4b-49f4-9861-7605aee06887 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a5c1859e-df4b-49f4-9861-7605aee06887 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 HTTP/1.1 May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:05:38.757079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:05:38.758786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:05:38.758786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:05:38.758786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:05:38.758786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:05:38.758786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:05:38.758786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:05:38.758786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:05:38.758786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:05:38.758786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:05:38.758786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:05:38.758786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:05:38.758786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '1248649c-ce32-42fd-8764-3a985faf06b8'} May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:05:38.759595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:05:38.761314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:38.762741 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a5c1859e-df4b-49f4-9861-7605aee06887 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 404 to user: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:05:38.762741 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a5c1859e-df4b-49f4-9861-7605aee06887 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 404 len: 111 microversion: 2.1 time: 0.031746 May 26 17:05:38.762741 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 425/826] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:38 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:05:38.767703 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-feb3a3e1-3cb7-48fe-bbd9-e755c5adc4bb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '.version_select at 0x7fd25114e310>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:38.909004 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-feb3a3e1-3cb7-48fe-bbd9-e755c5adc4bb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805569523" status: 202 len: 0 microversion: 2.1 time: 0.144980 May 26 17:05:38.909655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 402/827] 10.222.0.112 () {58 vars in 1225 bytes} [Thu May 26 17:05:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805569523 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:05:39.406978 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-cbd6320d-80b0-4fc2-9c36-ce0d7ce57cb9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:39.407917 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-cbd6320d-80b0-4fc2-9c36-ce0d7ce57cb9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:39.412841 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:39.416405 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cbd6320d-80b0-4fc2-9c36-ce0d7ce57cb9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:39.416860 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cbd6320d-80b0-4fc2-9c36-ce0d7ce57cb9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:39.418249 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cbd6320d-80b0-4fc2-9c36-ce0d7ce57cb9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:39.418794 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cbd6320d-80b0-4fc2-9c36-ce0d7ce57cb9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:39.639019 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cbd6320d-80b0-4fc2-9c36-ce0d7ce57cb9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:39.647028 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-cbd6320d-80b0-4fc2-9c36-ce0d7ce57cb9 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.245348 May 26 17:05:39.647587 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 426/828] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:39 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:39.739661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4f6ca4ee-bdc3-4913-9e4a-d4a25e0a9621 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:39.740344 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4f6ca4ee-bdc3-4913-9e4a-d4a25e0a9621 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:39.747488 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4f6ca4ee-bdc3-4913-9e4a-d4a25e0a9621 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:39.748010 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4f6ca4ee-bdc3-4913-9e4a-d4a25e0a9621 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:39.750811 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4f6ca4ee-bdc3-4913-9e4a-d4a25e0a9621 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:39.750811 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4f6ca4ee-bdc3-4913-9e4a-d4a25e0a9621 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:39.915466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-21b1e43b-7d20-4b6a-b45b-1bd646c481f6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:39.916633 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-21b1e43b-7d20-4b6a-b45b-1bd646c481f6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:39.916778 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4f6ca4ee-bdc3-4913-9e4a-d4a25e0a9621 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:39.923797 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-21b1e43b-7d20-4b6a-b45b-1bd646c481f6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:39.924391 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-21b1e43b-7d20-4b6a-b45b-1bd646c481f6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:39.925268 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4f6ca4ee-bdc3-4913-9e4a-d4a25e0a9621 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.190279 May 26 17:05:39.925394 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-21b1e43b-7d20-4b6a-b45b-1bd646c481f6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:39.925856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 403/829] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:39 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:39.926018 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-21b1e43b-7d20-4b6a-b45b-1bd646c481f6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:40.009539 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-21b1e43b-7d20-4b6a-b45b-1bd646c481f6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lazy-loading 'services' on Instance uuid 60352cdb-28fe-49a5-85e8-ae2c9c92b184 {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:05:40.278224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-21b1e43b-7d20-4b6a-b45b-1bd646c481f6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/os-volume_attachments/86f46ceb-ae94-4737-b499-2a352dcad793" status: 202 len: 0 microversion: 2.1 time: 0.367039 May 26 17:05:40.278855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 427/830] 10.222.0.112 () {58 vars in 1420 bytes} [Thu May 26 17:05:39 2022] DELETE /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/os-volume_attachments/86f46ceb-ae94-4737-b499-2a352dcad793 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:05:40.287364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cf83bde0-951b-44a4-9aa0-a20291185fcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:40.288342 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cf83bde0-951b-44a4-9aa0-a20291185fcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:40.294554 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf83bde0-951b-44a4-9aa0-a20291185fcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:40.295010 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf83bde0-951b-44a4-9aa0-a20291185fcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:40.295798 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf83bde0-951b-44a4-9aa0-a20291185fcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:40.296238 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf83bde0-951b-44a4-9aa0-a20291185fcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:40.328514 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cf83bde0-951b-44a4-9aa0-a20291185fcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 May 26 17:05:40.329162 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 404/831] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:05:40 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:40.666084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5d3fa706-0d9a-4760-b71e-77042f87f57b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:40.666837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5d3fa706-0d9a-4760-b71e-77042f87f57b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:40.673219 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5d3fa706-0d9a-4760-b71e-77042f87f57b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:40.673669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5d3fa706-0d9a-4760-b71e-77042f87f57b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:40.674458 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5d3fa706-0d9a-4760-b71e-77042f87f57b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:40.674901 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5d3fa706-0d9a-4760-b71e-77042f87f57b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:40.807603 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5d3fa706-0d9a-4760-b71e-77042f87f57b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:40.816958 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5d3fa706-0d9a-4760-b71e-77042f87f57b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.155594 May 26 17:05:40.817541 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 428/832] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:40 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:40.943023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6d155700-ce53-49f9-afbd-cdf5200e36d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:40.943570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6d155700-ce53-49f9-afbd-cdf5200e36d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:40.950717 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6d155700-ce53-49f9-afbd-cdf5200e36d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:40.951172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6d155700-ce53-49f9-afbd-cdf5200e36d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:40.951916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6d155700-ce53-49f9-afbd-cdf5200e36d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:40.952344 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6d155700-ce53-49f9-afbd-cdf5200e36d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:41.088631 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6d155700-ce53-49f9-afbd-cdf5200e36d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:41.096274 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6d155700-ce53-49f9-afbd-cdf5200e36d4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.157188 May 26 17:05:41.096845 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 405/833] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:40 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:41.340761 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-54cdc5ce-d46b-41de-9341-962ad11b0505 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:41.341753 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-54cdc5ce-d46b-41de-9341-962ad11b0505 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:41.347813 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54cdc5ce-d46b-41de-9341-962ad11b0505 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:41.348306 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54cdc5ce-d46b-41de-9341-962ad11b0505 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:41.349060 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54cdc5ce-d46b-41de-9341-962ad11b0505 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:41.349489 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54cdc5ce-d46b-41de-9341-962ad11b0505 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:41.378667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-54cdc5ce-d46b-41de-9341-962ad11b0505 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042138 May 26 17:05:41.379214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 429/834] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:05:41 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:41.506361 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-fb8625d1-2d6c-4c36-8304-84f5d4620e51 req-963f011d-fc1f-4ddf-b645-9bcd80879949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8949ea8b-a66a-4c3d-a048-3020e3d8b7f9", "name": "network-vif-plugged", "status": "completed", "tag": "c3bb5511-a235-4369-a160-73fb0904cf14"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:41.514727 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-fb8625d1-2d6c-4c36-8304-84f5d4620e51 req-963f011d-fc1f-4ddf-b645-9bcd80879949 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:41.515176 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-fb8625d1-2d6c-4c36-8304-84f5d4620e51 req-963f011d-fc1f-4ddf-b645-9bcd80879949 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:41.526258 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-fb8625d1-2d6c-4c36-8304-84f5d4620e51 req-963f011d-fc1f-4ddf-b645-9bcd80879949 service nova] Creating event network-vif-plugged:c3bb5511-a235-4369-a160-73fb0904cf14 for instance 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 on hv-cinder-83607 May 26 17:05:41.531969 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-fb8625d1-2d6c-4c36-8304-84f5d4620e51 req-963f011d-fc1f-4ddf-b645-9bcd80879949 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029307 May 26 17:05:41.532577 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 406/835] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:41.835760 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e0db39ff-2343-498e-99a8-d1bc5ff0fe1f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:41.836325 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e0db39ff-2343-498e-99a8-d1bc5ff0fe1f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:41.842838 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e0db39ff-2343-498e-99a8-d1bc5ff0fe1f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:41.843276 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e0db39ff-2343-498e-99a8-d1bc5ff0fe1f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:41.844036 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e0db39ff-2343-498e-99a8-d1bc5ff0fe1f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:41.844465 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e0db39ff-2343-498e-99a8-d1bc5ff0fe1f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:41.976036 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e0db39ff-2343-498e-99a8-d1bc5ff0fe1f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:41.985034 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e0db39ff-2343-498e-99a8-d1bc5ff0fe1f tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.153322 May 26 17:05:41.985831 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 430/836] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:41 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:42.114059 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0223a771-d8cf-48c9-bf75-424f1416b9aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:42.114654 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0223a771-d8cf-48c9-bf75-424f1416b9aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:42.121476 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0223a771-d8cf-48c9-bf75-424f1416b9aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:42.121920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0223a771-d8cf-48c9-bf75-424f1416b9aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:42.122707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0223a771-d8cf-48c9-bf75-424f1416b9aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:42.123138 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0223a771-d8cf-48c9-bf75-424f1416b9aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:42.271631 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0223a771-d8cf-48c9-bf75-424f1416b9aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:42.279173 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0223a771-d8cf-48c9-bf75-424f1416b9aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.169806 May 26 17:05:42.279981 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 407/837] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:42 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:42.390679 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-19231551-1ac0-4768-b0d2-bc5d8a63e729 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:42.391607 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-19231551-1ac0-4768-b0d2-bc5d8a63e729 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:42.397559 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-19231551-1ac0-4768-b0d2-bc5d8a63e729 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:42.398008 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-19231551-1ac0-4768-b0d2-bc5d8a63e729 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:42.398796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-19231551-1ac0-4768-b0d2-bc5d8a63e729 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:42.399238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-19231551-1ac0-4768-b0d2-bc5d8a63e729 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:42.428337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-19231551-1ac0-4768-b0d2-bc5d8a63e729 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041724 May 26 17:05:42.428891 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 431/838] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:05:42 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:05:42.488059 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cd4ff2f4-e3af-4873-a42e-66532e3271d4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:42.488573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cd4ff2f4-e3af-4873-a42e-66532e3271d4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:42.494551 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd4ff2f4-e3af-4873-a42e-66532e3271d4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:42.494998 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd4ff2f4-e3af-4873-a42e-66532e3271d4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:42.495969 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd4ff2f4-e3af-4873-a42e-66532e3271d4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:42.496548 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd4ff2f4-e3af-4873-a42e-66532e3271d4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:42.520918 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cd4ff2f4-e3af-4873-a42e-66532e3271d4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Going to try to terminate instance {{(pid=130525) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:05:42.535883 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:42.844745 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cd4ff2f4-e3af-4873-a42e-66532e3271d4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 204 len: 0 microversion: 2.1 time: 0.360242 May 26 17:05:42.845254 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 408/839] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:05:42 2022] DELETE /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:05:42.859168 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-40c4ab14-0e4d-4f9e-bae8-8d0d2d51d6a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:42.859824 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-40c4ab14-0e4d-4f9e-bae8-8d0d2d51d6a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:42.865724 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-40c4ab14-0e4d-4f9e-bae8-8d0d2d51d6a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:42.866173 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-40c4ab14-0e4d-4f9e-bae8-8d0d2d51d6a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:42.866983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-40c4ab14-0e4d-4f9e-bae8-8d0d2d51d6a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:42.867422 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-40c4ab14-0e4d-4f9e-bae8-8d0d2d51d6a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:42.999181 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-40c4ab14-0e4d-4f9e-bae8-8d0d2d51d6a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:43.003571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8255cf7e-6a1f-4445-84b6-b70cd06e1970 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:43.011806 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8255cf7e-6a1f-4445-84b6-b70cd06e1970 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:43.011966 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-40c4ab14-0e4d-4f9e-bae8-8d0d2d51d6a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1685 microversion: 2.1 time: 0.158139 May 26 17:05:43.011966 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 432/840] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:42 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:43.012157 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8255cf7e-6a1f-4445-84b6-b70cd06e1970 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:43.012157 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8255cf7e-6a1f-4445-84b6-b70cd06e1970 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:43.012157 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8255cf7e-6a1f-4445-84b6-b70cd06e1970 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:43.012524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8255cf7e-6a1f-4445-84b6-b70cd06e1970 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:43.153211 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8255cf7e-6a1f-4445-84b6-b70cd06e1970 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:43.161170 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8255cf7e-6a1f-4445-84b6-b70cd06e1970 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.161964 May 26 17:05:43.161739 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 409/841] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:42 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:43.296582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-72ad1ab5-e31d-4bbc-a2b4-84144b06035a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:43.297202 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-72ad1ab5-e31d-4bbc-a2b4-84144b06035a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:43.303454 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-72ad1ab5-e31d-4bbc-a2b4-84144b06035a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:43.303910 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-72ad1ab5-e31d-4bbc-a2b4-84144b06035a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:43.304675 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-72ad1ab5-e31d-4bbc-a2b4-84144b06035a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:43.305111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-72ad1ab5-e31d-4bbc-a2b4-84144b06035a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:43.322909 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:43.437628 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-72ad1ab5-e31d-4bbc-a2b4-84144b06035a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:43.445019 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-72ad1ab5-e31d-4bbc-a2b4-84144b06035a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.152887 May 26 17:05:43.445615 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 433/842] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:43 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:44.025024 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0d9c564d-36dc-4a1b-8f7c-386e3aa81856 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:44.025630 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0d9c564d-36dc-4a1b-8f7c-386e3aa81856 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:44.032491 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0d9c564d-36dc-4a1b-8f7c-386e3aa81856 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:44.032933 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0d9c564d-36dc-4a1b-8f7c-386e3aa81856 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:44.033693 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0d9c564d-36dc-4a1b-8f7c-386e3aa81856 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:44.034126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0d9c564d-36dc-4a1b-8f7c-386e3aa81856 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:44.163238 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0d9c564d-36dc-4a1b-8f7c-386e3aa81856 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:44.171307 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0d9c564d-36dc-4a1b-8f7c-386e3aa81856 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1685 microversion: 2.1 time: 0.150187 May 26 17:05:44.171869 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 410/843] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:44 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:44.178607 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-511c1f3e-5596-4c2e-9365-344ea8859e6b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:44.179251 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-511c1f3e-5596-4c2e-9365-344ea8859e6b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:44.186727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-511c1f3e-5596-4c2e-9365-344ea8859e6b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:44.187178 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-511c1f3e-5596-4c2e-9365-344ea8859e6b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:44.187951 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-511c1f3e-5596-4c2e-9365-344ea8859e6b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:44.188395 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-511c1f3e-5596-4c2e-9365-344ea8859e6b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:44.325555 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-511c1f3e-5596-4c2e-9365-344ea8859e6b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:44.334102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-511c1f3e-5596-4c2e-9365-344ea8859e6b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.159189 May 26 17:05:44.334709 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 434/844] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:44 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:44.462592 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-69b94961-2ae1-403f-b7a1-718e15cbffda tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:44.463205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-69b94961-2ae1-403f-b7a1-718e15cbffda tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:44.469423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-69b94961-2ae1-403f-b7a1-718e15cbffda tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:44.469879 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-69b94961-2ae1-403f-b7a1-718e15cbffda tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:44.470683 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-69b94961-2ae1-403f-b7a1-718e15cbffda tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:44.471129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-69b94961-2ae1-403f-b7a1-718e15cbffda tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:44.609769 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-69b94961-2ae1-403f-b7a1-718e15cbffda tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:44.617360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-69b94961-2ae1-403f-b7a1-718e15cbffda tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.158669 May 26 17:05:44.617941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 411/845] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:44 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:45.187492 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-854d8fd6-26cc-4c05-8deb-2dbeb92088a1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:45.188097 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-854d8fd6-26cc-4c05-8deb-2dbeb92088a1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:45.194582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-854d8fd6-26cc-4c05-8deb-2dbeb92088a1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:45.195033 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-854d8fd6-26cc-4c05-8deb-2dbeb92088a1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:45.195791 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-854d8fd6-26cc-4c05-8deb-2dbeb92088a1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:45.196224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-854d8fd6-26cc-4c05-8deb-2dbeb92088a1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:45.326032 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-854d8fd6-26cc-4c05-8deb-2dbeb92088a1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:45.333769 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-854d8fd6-26cc-4c05-8deb-2dbeb92088a1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1685 microversion: 2.1 time: 0.150075 May 26 17:05:45.334369 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 435/846] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:45 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:45.351243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-13668e4c-7195-4048-9330-1913f1f7ee02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:45.351889 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-13668e4c-7195-4048-9330-1913f1f7ee02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:45.358876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-13668e4c-7195-4048-9330-1913f1f7ee02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:45.359310 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-13668e4c-7195-4048-9330-1913f1f7ee02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:45.360090 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-13668e4c-7195-4048-9330-1913f1f7ee02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:45.360528 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-13668e4c-7195-4048-9330-1913f1f7ee02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:45.496072 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-13668e4c-7195-4048-9330-1913f1f7ee02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:45.503921 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-13668e4c-7195-4048-9330-1913f1f7ee02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.156581 May 26 17:05:45.504494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 412/847] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:45 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:45.634231 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1dc97357-fa24-4f99-9705-52cef99c726e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:45.634889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1dc97357-fa24-4f99-9705-52cef99c726e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:45.641387 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1dc97357-fa24-4f99-9705-52cef99c726e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:45.641834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1dc97357-fa24-4f99-9705-52cef99c726e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:45.642621 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1dc97357-fa24-4f99-9705-52cef99c726e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:45.643058 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1dc97357-fa24-4f99-9705-52cef99c726e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:46.132487 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1dc97357-fa24-4f99-9705-52cef99c726e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:46.141031 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1dc97357-fa24-4f99-9705-52cef99c726e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.510727 May 26 17:05:46.141595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 436/848] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:45 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:46.351008 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-07fa7d5a-d8ae-4662-a766-44ea9bc5956a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:46.351632 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-07fa7d5a-d8ae-4662-a766-44ea9bc5956a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:46.358125 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-07fa7d5a-d8ae-4662-a766-44ea9bc5956a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:46.358608 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-07fa7d5a-d8ae-4662-a766-44ea9bc5956a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:46.359385 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-07fa7d5a-d8ae-4662-a766-44ea9bc5956a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:46.359822 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-07fa7d5a-d8ae-4662-a766-44ea9bc5956a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:46.488377 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-07fa7d5a-d8ae-4662-a766-44ea9bc5956a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:46.496548 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-07fa7d5a-d8ae-4662-a766-44ea9bc5956a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1685 microversion: 2.1 time: 0.149475 May 26 17:05:46.497117 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 413/849] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:46 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:46.521334 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4077d66b-46f4-41fb-a1eb-d084e1f8b9d0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:46.521937 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4077d66b-46f4-41fb-a1eb-d084e1f8b9d0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:46.528551 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4077d66b-46f4-41fb-a1eb-d084e1f8b9d0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:46.529007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4077d66b-46f4-41fb-a1eb-d084e1f8b9d0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:46.529756 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4077d66b-46f4-41fb-a1eb-d084e1f8b9d0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:46.530182 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4077d66b-46f4-41fb-a1eb-d084e1f8b9d0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:46.658725 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4077d66b-46f4-41fb-a1eb-d084e1f8b9d0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:46.666779 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4077d66b-46f4-41fb-a1eb-d084e1f8b9d0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.149335 May 26 17:05:46.667841 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 437/850] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:46 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:47.158404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-05189b36-7e34-4a4d-91f6-4dc08916b619 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:47.159023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-05189b36-7e34-4a4d-91f6-4dc08916b619 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:47.165309 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-05189b36-7e34-4a4d-91f6-4dc08916b619 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:47.165759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-05189b36-7e34-4a4d-91f6-4dc08916b619 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:47.166549 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-05189b36-7e34-4a4d-91f6-4dc08916b619 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:47.166985 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-05189b36-7e34-4a4d-91f6-4dc08916b619 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:47.301714 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-05189b36-7e34-4a4d-91f6-4dc08916b619 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:47.309763 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-05189b36-7e34-4a4d-91f6-4dc08916b619 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.155318 May 26 17:05:47.311241 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 414/851] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:47 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:47.514177 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5b612321-6d78-4c68-8aca-448be6e96920 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:47.514728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5b612321-6d78-4c68-8aca-448be6e96920 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:47.520642 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b612321-6d78-4c68-8aca-448be6e96920 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:47.521094 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b612321-6d78-4c68-8aca-448be6e96920 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:47.521852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b612321-6d78-4c68-8aca-448be6e96920 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:47.522451 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b612321-6d78-4c68-8aca-448be6e96920 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:47.650951 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5b612321-6d78-4c68-8aca-448be6e96920 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:47.659174 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5b612321-6d78-4c68-8aca-448be6e96920 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1685 microversion: 2.1 time: 0.149481 May 26 17:05:47.659739 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 438/852] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:47 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:47.684676 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-853788a9-8a77-4efb-862f-27067ace644c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:47.685296 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-853788a9-8a77-4efb-862f-27067ace644c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:47.691788 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-853788a9-8a77-4efb-862f-27067ace644c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:47.692247 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-853788a9-8a77-4efb-862f-27067ace644c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:47.693023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-853788a9-8a77-4efb-862f-27067ace644c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:47.693464 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-853788a9-8a77-4efb-862f-27067ace644c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:47.826296 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-853788a9-8a77-4efb-862f-27067ace644c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:47.834509 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-853788a9-8a77-4efb-862f-27067ace644c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.154165 May 26 17:05:47.835081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 415/853] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:47 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:48.186301 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-02b796d5-89a1-48fb-a107-c94fb9269eb3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-657202360"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:48.186868 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-02b796d5-89a1-48fb-a107-c94fb9269eb3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:48.192821 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02b796d5-89a1-48fb-a107-c94fb9269eb3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:48.193273 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02b796d5-89a1-48fb-a107-c94fb9269eb3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:48.194042 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02b796d5-89a1-48fb-a107-c94fb9269eb3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:48.194516 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02b796d5-89a1-48fb-a107-c94fb9269eb3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:48.321837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.network.security_group_api [None req-02b796d5-89a1-48fb-a107-c94fb9269eb3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Removing security group 591bca03-0a6d-4e79-9610-096015b4a9c4 from port 8f683af9-2af5-45b8-b6cb-ef44b939789d May 26 17:05:48.326552 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3103f267-2a4d-4f3e-82f1-e47401c67d13 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:48.327161 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3103f267-2a4d-4f3e-82f1-e47401c67d13 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:48.333453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3103f267-2a4d-4f3e-82f1-e47401c67d13 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:48.333904 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3103f267-2a4d-4f3e-82f1-e47401c67d13 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:48.334707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3103f267-2a4d-4f3e-82f1-e47401c67d13 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:48.335146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3103f267-2a4d-4f3e-82f1-e47401c67d13 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:48.548368 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3103f267-2a4d-4f3e-82f1-e47401c67d13 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:48.556144 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3103f267-2a4d-4f3e-82f1-e47401c67d13 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1269 microversion: 2.1 time: 0.233507 May 26 17:05:48.556711 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 416/854] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:48 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1269 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:48.676794 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a9db3908-9691-49a4-8214-b296dcc11675 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:48.677953 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a9db3908-9691-49a4-8214-b296dcc11675 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:48.685535 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a9db3908-9691-49a4-8214-b296dcc11675 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:48.686765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a9db3908-9691-49a4-8214-b296dcc11675 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:48.687728 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a9db3908-9691-49a4-8214-b296dcc11675 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:48.688320 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a9db3908-9691-49a4-8214-b296dcc11675 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:48.851360 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-02b796d5-89a1-48fb-a107-c94fb9269eb3 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "POST /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/action" status: 202 len: 0 microversion: 2.1 time: 0.768784 May 26 17:05:48.854414 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 439/855] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:05:48 2022] POST /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/action => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:05:48.861452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bf54b9ea-0e41-4e03-952b-5a5340a75dee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:48.862545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bf54b9ea-0e41-4e03-952b-5a5340a75dee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:48.879563 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bf54b9ea-0e41-4e03-952b-5a5340a75dee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:48.880252 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bf54b9ea-0e41-4e03-952b-5a5340a75dee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:48.881221 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bf54b9ea-0e41-4e03-952b-5a5340a75dee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:48.882264 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bf54b9ea-0e41-4e03-952b-5a5340a75dee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:48.973300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a9db3908-9691-49a4-8214-b296dcc11675 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:48.984202 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a9db3908-9691-49a4-8214-b296dcc11675 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1685 microversion: 2.1 time: 0.311394 May 26 17:05:48.986401 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 417/856] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:48 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1685 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:49.081423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-bae9580a-2543-48fe-9d7c-1361e0112596 req-0c83c936-1a4d-4076-b5ca-261e5fd21cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d526ee14-28c1-46f0-97e9-37aecfc19059", "tag": "8f683af9-2af5-45b8-b6cb-ef44b939789d"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:49.093810 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-bae9580a-2543-48fe-9d7c-1361e0112596 req-0c83c936-1a4d-4076-b5ca-261e5fd21cdc service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:49.096584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-bae9580a-2543-48fe-9d7c-1361e0112596 req-0c83c936-1a4d-4076-b5ca-261e5fd21cdc service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:49.112109 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-bae9580a-2543-48fe-9d7c-1361e0112596 req-0c83c936-1a4d-4076-b5ca-261e5fd21cdc service nova] Creating event network-changed:8f683af9-2af5-45b8-b6cb-ef44b939789d for instance d526ee14-28c1-46f0-97e9-37aecfc19059 on hv-cinder-83607 May 26 17:05:49.117435 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-bae9580a-2543-48fe-9d7c-1361e0112596 req-0c83c936-1a4d-4076-b5ca-261e5fd21cdc service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129705 May 26 17:05:49.118654 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 418/857] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:49.159503 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bf54b9ea-0e41-4e03-952b-5a5340a75dee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:49.172531 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bf54b9ea-0e41-4e03-952b-5a5340a75dee tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.316520 May 26 17:05:49.177122 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 440/858] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:48 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:49.573781 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cd4f1861-f698-4d6f-a434-7cb3d7775b90 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:49.574836 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cd4f1861-f698-4d6f-a434-7cb3d7775b90 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:49.581475 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd4f1861-f698-4d6f-a434-7cb3d7775b90 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:49.581934 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd4f1861-f698-4d6f-a434-7cb3d7775b90 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:49.582748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd4f1861-f698-4d6f-a434-7cb3d7775b90 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:49.583366 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd4f1861-f698-4d6f-a434-7cb3d7775b90 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:49.804053 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cd4f1861-f698-4d6f-a434-7cb3d7775b90 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:49.811679 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cd4f1861-f698-4d6f-a434-7cb3d7775b90 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1456 microversion: 2.1 time: 0.242167 May 26 17:05:49.812262 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 419/859] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:49 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1456 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:49.831429 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-19771432-49e8-49d7-a8a5-62f1b1a9fb19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:49.832043 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-19771432-49e8-49d7-a8a5-62f1b1a9fb19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:49.844136 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-19771432-49e8-49d7-a8a5-62f1b1a9fb19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:49.844588 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-19771432-49e8-49d7-a8a5-62f1b1a9fb19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:49.845368 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-19771432-49e8-49d7-a8a5-62f1b1a9fb19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:49.845823 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-19771432-49e8-49d7-a8a5-62f1b1a9fb19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:49.883419 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-8160ac17-6b43-4925-ae00-7d71ede2717f req-06b398dc-dae3-47ad-a08b-123bf2e7feab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60352cdb-28fe-49a5-85e8-ae2c9c92b184", "name": "network-vif-deleted", "tag": "7f96d44e-35cb-48aa-a514-fdf4fed75c08"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:49.896747 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-8160ac17-6b43-4925-ae00-7d71ede2717f req-06b398dc-dae3-47ad-a08b-123bf2e7feab service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:49.897526 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-8160ac17-6b43-4925-ae00-7d71ede2717f req-06b398dc-dae3-47ad-a08b-123bf2e7feab service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:49.911149 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-8160ac17-6b43-4925-ae00-7d71ede2717f req-06b398dc-dae3-47ad-a08b-123bf2e7feab service nova] Creating event network-vif-deleted:7f96d44e-35cb-48aa-a514-fdf4fed75c08 for instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 on hv-cinder-83607 May 26 17:05:49.916626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-8160ac17-6b43-4925-ae00-7d71ede2717f req-06b398dc-dae3-47ad-a08b-123bf2e7feab service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036908 May 26 17:05:49.921506 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 420/860] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:05:50.005365 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e3904c57-9d18-4dda-a468-470402ff5d19 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:50.006954 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e3904c57-9d18-4dda-a468-470402ff5d19 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:50.016648 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e3904c57-9d18-4dda-a468-470402ff5d19 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:50.017679 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e3904c57-9d18-4dda-a468-470402ff5d19 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:50.018736 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e3904c57-9d18-4dda-a468-470402ff5d19 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:50.019376 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e3904c57-9d18-4dda-a468-470402ff5d19 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:50.110037 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e3904c57-9d18-4dda-a468-470402ff5d19 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:50.118214 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e3904c57-9d18-4dda-a468-470402ff5d19 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1617 microversion: 2.1 time: 0.117553 May 26 17:05:50.121342 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 421/861] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:49 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1617 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:50.139949 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-19771432-49e8-49d7-a8a5-62f1b1a9fb19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:50.147387 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-19771432-49e8-49d7-a8a5-62f1b1a9fb19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1456 microversion: 2.1 time: 0.320116 May 26 17:05:50.147957 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 441/862] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:49 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1456 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:50.189285 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fd1d16b7-b979-4e21-8815-9c0ae05ca2d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:50.190188 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fd1d16b7-b979-4e21-8815-9c0ae05ca2d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:50.197183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd1d16b7-b979-4e21-8815-9c0ae05ca2d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:50.197840 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd1d16b7-b979-4e21-8815-9c0ae05ca2d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:50.199538 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd1d16b7-b979-4e21-8815-9c0ae05ca2d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:50.200151 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fd1d16b7-b979-4e21-8815-9c0ae05ca2d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:50.396997 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fd1d16b7-b979-4e21-8815-9c0ae05ca2d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:50.411202 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fd1d16b7-b979-4e21-8815-9c0ae05ca2d1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.224560 May 26 17:05:50.421803 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 422/863] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:50 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:50.533183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-df7ff50f-52c3-43f7-9eff-d79bb9f89784 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:50.533810 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-df7ff50f-52c3-43f7-9eff-d79bb9f89784 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:50.540613 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-df7ff50f-52c3-43f7-9eff-d79bb9f89784 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:50.543359 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-df7ff50f-52c3-43f7-9eff-d79bb9f89784 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:50.545375 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-df7ff50f-52c3-43f7-9eff-d79bb9f89784 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:50.545992 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-df7ff50f-52c3-43f7-9eff-d79bb9f89784 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:50.668853 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-df7ff50f-52c3-43f7-9eff-d79bb9f89784 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lazy-loading 'services' on Instance uuid d526ee14-28c1-46f0-97e9-37aecfc19059 {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:05:51.033262 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-df7ff50f-52c3-43f7-9eff-d79bb9f89784 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "DELETE /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments/9532b609-dcf3-4360-87af-f3c66640ca56" status: 202 len: 0 microversion: 2.1 time: 0.504302 May 26 17:05:51.053403 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b759ce0c-a449-4fff-aa76-3bdc2407e521 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:51.055854 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 442/864] 10.222.0.112 () {58 vars in 1420 bytes} [Thu May 26 17:05:50 2022] DELETE /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments/9532b609-dcf3-4360-87af-f3c66640ca56 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:05:51.056573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b759ce0c-a449-4fff-aa76-3bdc2407e521 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:51.064299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b759ce0c-a449-4fff-aa76-3bdc2407e521 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:51.064999 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b759ce0c-a449-4fff-aa76-3bdc2407e521 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:51.065929 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b759ce0c-a449-4fff-aa76-3bdc2407e521 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:51.066536 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b759ce0c-a449-4fff-aa76-3bdc2407e521 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:51.102093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b759ce0c-a449-4fff-aa76-3bdc2407e521 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063299 May 26 17:05:51.107438 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 423/865] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:05:51 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:51.136944 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-6e81f29e-7ec6-40a8-92ac-2a14a9f701b5 req-6350b2b0-3381-45ec-bbdd-1092b3a31461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d526ee14-28c1-46f0-97e9-37aecfc19059", "tag": "8f683af9-2af5-45b8-b6cb-ef44b939789d"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:51.140677 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2b219a1a-090e-4ffe-83a6-e84d5b7cebfc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:51.141441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-2b219a1a-090e-4ffe-83a6-e84d5b7cebfc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:51.146161 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-6e81f29e-7ec6-40a8-92ac-2a14a9f701b5 req-6350b2b0-3381-45ec-bbdd-1092b3a31461 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:51.152316 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-6e81f29e-7ec6-40a8-92ac-2a14a9f701b5 req-6350b2b0-3381-45ec-bbdd-1092b3a31461 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:51.152446 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2b219a1a-090e-4ffe-83a6-e84d5b7cebfc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:51.152446 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2b219a1a-090e-4ffe-83a6-e84d5b7cebfc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:51.153274 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2b219a1a-090e-4ffe-83a6-e84d5b7cebfc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:51.154498 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2b219a1a-090e-4ffe-83a6-e84d5b7cebfc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:51.160232 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-6e81f29e-7ec6-40a8-92ac-2a14a9f701b5 req-6350b2b0-3381-45ec-bbdd-1092b3a31461 service nova] Creating event network-changed:8f683af9-2af5-45b8-b6cb-ef44b939789d for instance d526ee14-28c1-46f0-97e9-37aecfc19059 on hv-cinder-83607 May 26 17:05:51.165480 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-6e81f29e-7ec6-40a8-92ac-2a14a9f701b5 req-6350b2b0-3381-45ec-bbdd-1092b3a31461 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033725 May 26 17:05:51.169939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 443/866] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:51.255461 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2b219a1a-090e-4ffe-83a6-e84d5b7cebfc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:51.265240 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-2b219a1a-090e-4ffe-83a6-e84d5b7cebfc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1330 microversion: 2.1 time: 0.131854 May 26 17:05:51.266262 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 424/867] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:51 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1330 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:51.429585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4689a07c-6348-47a4-976f-cd1945139c8e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:51.430307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4689a07c-6348-47a4-976f-cd1945139c8e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:51.438223 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4689a07c-6348-47a4-976f-cd1945139c8e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:51.438763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4689a07c-6348-47a4-976f-cd1945139c8e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:51.439565 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4689a07c-6348-47a4-976f-cd1945139c8e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:51.440024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4689a07c-6348-47a4-976f-cd1945139c8e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:51.587820 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4689a07c-6348-47a4-976f-cd1945139c8e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:51.599321 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4689a07c-6348-47a4-976f-cd1945139c8e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.174119 May 26 17:05:51.600107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 444/868] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:51 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:52.114404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-11f102f9-a982-4013-b62c-d8d174a1ad95 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:52.115342 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-11f102f9-a982-4013-b62c-d8d174a1ad95 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:52.122191 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-11f102f9-a982-4013-b62c-d8d174a1ad95 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:52.122673 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-11f102f9-a982-4013-b62c-d8d174a1ad95 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:52.123457 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-11f102f9-a982-4013-b62c-d8d174a1ad95 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:52.123894 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-11f102f9-a982-4013-b62c-d8d174a1ad95 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:52.143838 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:52.159861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-11f102f9-a982-4013-b62c-d8d174a1ad95 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049437 May 26 17:05:52.160646 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 425/869] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:05:52 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:52.282531 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c91bf781-dd56-42ae-9127-a678bb1d2cb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:52.283272 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c91bf781-dd56-42ae-9127-a678bb1d2cb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:52.289910 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c91bf781-dd56-42ae-9127-a678bb1d2cb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:52.290493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c91bf781-dd56-42ae-9127-a678bb1d2cb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:52.291327 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c91bf781-dd56-42ae-9127-a678bb1d2cb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:52.291883 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c91bf781-dd56-42ae-9127-a678bb1d2cb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:52.360226 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c91bf781-dd56-42ae-9127-a678bb1d2cb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:52.367969 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c91bf781-dd56-42ae-9127-a678bb1d2cb7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1330 microversion: 2.1 time: 0.089304 May 26 17:05:52.368540 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 445/870] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:52 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1330 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:52.618008 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-164e1373-9fba-492f-a9fc-23ec150067c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:52.620139 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-164e1373-9fba-492f-a9fc-23ec150067c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:52.627919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-164e1373-9fba-492f-a9fc-23ec150067c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:52.628376 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-164e1373-9fba-492f-a9fc-23ec150067c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:52.629165 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-164e1373-9fba-492f-a9fc-23ec150067c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:52.629602 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-164e1373-9fba-492f-a9fc-23ec150067c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:52.799956 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-8e30a38d-a800-4cfe-8870-87fa688f5c6a req-952a62f9-9942-4418-84b0-c9cb78568f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8949ea8b-a66a-4c3d-a048-3020e3d8b7f9", "tag": "c3bb5511-a235-4369-a160-73fb0904cf14"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:52.809566 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-8e30a38d-a800-4cfe-8870-87fa688f5c6a req-952a62f9-9942-4418-84b0-c9cb78568f80 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:52.810984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-8e30a38d-a800-4cfe-8870-87fa688f5c6a req-952a62f9-9942-4418-84b0-c9cb78568f80 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:52.815052 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-164e1373-9fba-492f-a9fc-23ec150067c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:52.821076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-8e30a38d-a800-4cfe-8870-87fa688f5c6a req-952a62f9-9942-4418-84b0-c9cb78568f80 service nova] Creating event network-changed:c3bb5511-a235-4369-a160-73fb0904cf14 for instance 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 on hv-cinder-83607 May 26 17:05:52.822969 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-164e1373-9fba-492f-a9fc-23ec150067c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1740 microversion: 2.1 time: 0.208806 May 26 17:05:52.826540 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 426/871] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:52 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:52.826822 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-8e30a38d-a800-4cfe-8870-87fa688f5c6a req-952a62f9-9942-4418-84b0-c9cb78568f80 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030384 May 26 17:05:52.827408 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 446/872] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:05:53.172079 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-88519bfd-919b-49ca-8ef7-0986dea54b88 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:53.173116 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-88519bfd-919b-49ca-8ef7-0986dea54b88 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:53.180506 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-88519bfd-919b-49ca-8ef7-0986dea54b88 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:53.180963 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-88519bfd-919b-49ca-8ef7-0986dea54b88 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:53.181748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-88519bfd-919b-49ca-8ef7-0986dea54b88 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:53.182195 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-88519bfd-919b-49ca-8ef7-0986dea54b88 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:53.213598 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-88519bfd-919b-49ca-8ef7-0986dea54b88 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045456 May 26 17:05:53.214153 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 427/873] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:05:53 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:53.386170 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-28f41b95-9916-479b-bdd3-8e94e57cac9d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:53.386902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-28f41b95-9916-479b-bdd3-8e94e57cac9d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:53.393657 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-28f41b95-9916-479b-bdd3-8e94e57cac9d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:53.394110 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-28f41b95-9916-479b-bdd3-8e94e57cac9d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:53.394920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-28f41b95-9916-479b-bdd3-8e94e57cac9d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:53.395359 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-28f41b95-9916-479b-bdd3-8e94e57cac9d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:53.483115 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-28f41b95-9916-479b-bdd3-8e94e57cac9d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:53.497301 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-28f41b95-9916-479b-bdd3-8e94e57cac9d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1330 microversion: 2.1 time: 0.109849 May 26 17:05:53.497301 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 447/874] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:53 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:53.843304 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-801189fc-87c2-4260-a774-bed1168645cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:53.843910 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-801189fc-87c2-4260-a774-bed1168645cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:53.849869 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-801189fc-87c2-4260-a774-bed1168645cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:53.850313 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-801189fc-87c2-4260-a774-bed1168645cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:53.851096 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-801189fc-87c2-4260-a774-bed1168645cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:53.851528 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-801189fc-87c2-4260-a774-bed1168645cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:53.996964 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-801189fc-87c2-4260-a774-bed1168645cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:54.005082 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-801189fc-87c2-4260-a774-bed1168645cd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1720 microversion: 2.1 time: 0.165663 May 26 17:05:54.005659 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 428/875] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:53 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:54.065284 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-27be7053-9aea-4132-9dd0-9b2ce2ba8c02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:54.065814 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-27be7053-9aea-4132-9dd0-9b2ce2ba8c02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:54.071791 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-27be7053-9aea-4132-9dd0-9b2ce2ba8c02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:54.072232 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-27be7053-9aea-4132-9dd0-9b2ce2ba8c02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:54.072987 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-27be7053-9aea-4132-9dd0-9b2ce2ba8c02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:54.073439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-27be7053-9aea-4132-9dd0-9b2ce2ba8c02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:54.162916 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-27be7053-9aea-4132-9dd0-9b2ce2ba8c02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] HTTP exception thrown: Cannot 'detach_volume' instance ea078281-ddf9-4637-9cfd-ca0709e2e74d while it is in vm_state rescued May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-27be7053-9aea-4132-9dd0-9b2ce2ba8c02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Request method failure captured: May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: DELETE /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments/a25459d1-2b07-4418-be96-1aaecf81518d HTTP/1.1 May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7ICrWbJE07SpsbGPvKFPZcXYZJyQkTyQK4OS5UehWo0LNcTgmpOR54Ko5HnVJ6hxOPBMJ-Hz5oXWE0LemMPQsWnjPq2QVy-5mm_exw_ya8_ffr8b9Pc59qAlGdLrwBR2X4SFcLofYd8EHjWCjXO1KVOMsnHVkBFVQ6uIKvJUgf0IBo May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: d84da619d6f042ed8ccf92259d52e180 May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:05:54.164617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:05:54.166187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_d84da619d6f042ed8ccf92259d52e180"}]}] May 26 17:05:54.166187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:05:54.166187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: d84da619d6f042ed8ccf92259d52e180 May 26 17:05:54.166187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:05:54.166187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-ServerRescueNegativeTestJSON-1303393345-project May 26 17:05:54.166187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:05:54.166187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:05:54.166187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: a3ccb15b11de4cfea727f0aa453f6e2b May 26 17:05:54.166187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1303393345-project May 26 17:05:54.166187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:05:54.166187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Cannot 'detach_volume' instance ea078281-ddf9-4637-9cfd-ca0709e2e74d while it is in vm_state rescued May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'server_id': 'ea078281-ddf9-4637-9cfd-ca0709e2e74d', 'id': 'a25459d1-2b07-4418-be96-1aaecf81518d'} May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea078281-ddf9-4637-9cfd-ca0709e2e74d in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:05:54.167619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ea078281-ddf9-4637-9cfd-ca0709e2e74d while it is in vm_state rescued May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ea078281-ddf9-4637-9cfd-ca0709e2e74d while it is in vm_state rescued May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:54.169275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-27be7053-9aea-4132-9dd0-9b2ce2ba8c02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Returning 409 to user: Cannot 'detach_volume' instance ea078281-ddf9-4637-9cfd-ca0709e2e74d while it is in vm_state rescued {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:05:54.170586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-27be7053-9aea-4132-9dd0-9b2ce2ba8c02 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "DELETE /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments/a25459d1-2b07-4418-be96-1aaecf81518d" status: 409 len: 152 microversion: 2.1 time: 0.105658 May 26 17:05:54.170586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 448/876] 10.222.0.112 () {58 vars in 1420 bytes} [Thu May 26 17:05:54 2022] DELETE /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments/a25459d1-2b07-4418-be96-1aaecf81518d => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 17:05:54.175811 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8771ab5a-17da-45b1-920b-016ee490f9eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:54.176350 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8771ab5a-17da-45b1-920b-016ee490f9eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:54.183621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8771ab5a-17da-45b1-920b-016ee490f9eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:54.184072 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8771ab5a-17da-45b1-920b-016ee490f9eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:54.184847 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8771ab5a-17da-45b1-920b-016ee490f9eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:54.185290 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8771ab5a-17da-45b1-920b-016ee490f9eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:54.226401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-86dae156-bbb6-4c4f-8b2f-dbf7f6d5e110 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:54.227605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-86dae156-bbb6-4c4f-8b2f-dbf7f6d5e110 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:54.235267 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-86dae156-bbb6-4c4f-8b2f-dbf7f6d5e110 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:54.235806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-86dae156-bbb6-4c4f-8b2f-dbf7f6d5e110 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:54.236649 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-86dae156-bbb6-4c4f-8b2f-dbf7f6d5e110 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:54.237190 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-86dae156-bbb6-4c4f-8b2f-dbf7f6d5e110 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:54.269231 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-86dae156-bbb6-4c4f-8b2f-dbf7f6d5e110 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046796 May 26 17:05:54.269882 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 449/877] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:05:54 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:54.419684 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8771ab5a-17da-45b1-920b-016ee490f9eb tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "POST /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/action" status: 202 len: 0 microversion: 2.1 time: 0.247485 May 26 17:05:54.420334 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 429/878] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:05:54 2022] POST /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:05:54.428445 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f823697d-6fef-4bb5-8077-825ab221d068 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:54.429066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f823697d-6fef-4bb5-8077-825ab221d068 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:54.436711 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f823697d-6fef-4bb5-8077-825ab221d068 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:54.437160 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f823697d-6fef-4bb5-8077-825ab221d068 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:54.437995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f823697d-6fef-4bb5-8077-825ab221d068 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:54.438458 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f823697d-6fef-4bb5-8077-825ab221d068 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:54.515918 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4365e502-fe42-40ea-bb2d-a15361d02733 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:54.516649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4365e502-fe42-40ea-bb2d-a15361d02733 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:54.523047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4365e502-fe42-40ea-bb2d-a15361d02733 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:54.523507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4365e502-fe42-40ea-bb2d-a15361d02733 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:54.524276 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4365e502-fe42-40ea-bb2d-a15361d02733 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:54.524713 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4365e502-fe42-40ea-bb2d-a15361d02733 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:54.556888 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4365e502-fe42-40ea-bb2d-a15361d02733 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:54.557824 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4365e502-fe42-40ea-bb2d-a15361d02733 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:54.558946 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-4365e502-fe42-40ea-bb2d-a15361d02733 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lazy-loading 'fault' on Instance uuid 60352cdb-28fe-49a5-85e8-ae2c9c92b184 {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:05:54.571803 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f823697d-6fef-4bb5-8077-825ab221d068 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:54.581689 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f823697d-6fef-4bb5-8077-825ab221d068 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1728 microversion: 2.1 time: 0.157038 May 26 17:05:54.582260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 450/879] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:54 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:54.600773 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4365e502-fe42-40ea-bb2d-a15361d02733 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:54.608791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4365e502-fe42-40ea-bb2d-a15361d02733 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 200 len: 1335 microversion: 2.1 time: 0.098270 May 26 17:05:54.609356 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 430/880] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:54 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:55.282231 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-24495382-4eee-4ad1-8f15-be6d22cad60b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:55.283920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-24495382-4eee-4ad1-8f15-be6d22cad60b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:55.290287 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-24495382-4eee-4ad1-8f15-be6d22cad60b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:55.290869 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-24495382-4eee-4ad1-8f15-be6d22cad60b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:55.291723 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-24495382-4eee-4ad1-8f15-be6d22cad60b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:55.292718 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-24495382-4eee-4ad1-8f15-be6d22cad60b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:55.296910 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:55.338483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-24495382-4eee-4ad1-8f15-be6d22cad60b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060738 May 26 17:05:55.339461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 451/881] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:05:55 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:55.607274 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7013f5d5-5419-4559-bdb7-6ef937ca8ece tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:55.607928 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7013f5d5-5419-4559-bdb7-6ef937ca8ece tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:55.615881 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7013f5d5-5419-4559-bdb7-6ef937ca8ece tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:55.619378 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7013f5d5-5419-4559-bdb7-6ef937ca8ece tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:55.619378 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7013f5d5-5419-4559-bdb7-6ef937ca8ece tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:55.619378 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7013f5d5-5419-4559-bdb7-6ef937ca8ece tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:55.627368 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b0d66c8c-71a9-4c9d-910f-42b907db1485 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:55.627974 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b0d66c8c-71a9-4c9d-910f-42b907db1485 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:55.637206 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b0d66c8c-71a9-4c9d-910f-42b907db1485 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:55.637650 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b0d66c8c-71a9-4c9d-910f-42b907db1485 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:55.638442 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b0d66c8c-71a9-4c9d-910f-42b907db1485 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:55.638877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b0d66c8c-71a9-4c9d-910f-42b907db1485 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:55.655746 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-b0d66c8c-71a9-4c9d-910f-42b907db1485 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b0d66c8c-71a9-4c9d-910f-42b907db1485 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 HTTP/1.1 May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:05:55.657673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:05:55.659873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:05:55.659873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:05:55.659873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:05:55.659873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:05:55.659873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:05:55.659873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:05:55.659873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:05:55.659873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:05:55.659873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:05:55.659873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:05:55.659873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:05:55.659873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '60352cdb-28fe-49a5-85e8-ae2c9c92b184'} May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:05:55.660605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:05:55.661736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:05:55.663707 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b0d66c8c-71a9-4c9d-910f-42b907db1485 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 404 to user: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:05:55.663707 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b0d66c8c-71a9-4c9d-910f-42b907db1485 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 404 len: 111 microversion: 2.1 time: 0.036333 May 26 17:05:55.663707 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 452/882] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:55 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:05:55.669719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6e6b514d-1511-4d3f-a8c6-5861e1f4fb55 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '.version_select at 0x7fd250f23700>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:55.778022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6e6b514d-1511-4d3f-a8c6-5861e1f4fb55 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-863389433" status: 202 len: 0 microversion: 2.1 time: 0.113192 May 26 17:05:55.778863 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 453/883] 10.222.0.112 () {58 vars in 1222 bytes} [Thu May 26 17:05:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-863389433 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:05:56.099168 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7013f5d5-5419-4559-bdb7-6ef937ca8ece tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:56.114547 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7013f5d5-5419-4559-bdb7-6ef937ca8ece tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1728 microversion: 2.1 time: 0.517103 May 26 17:05:56.115334 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 431/884] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:55 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1728 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:56.352089 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d50a60eb-3739-4ec1-9037-0285d742ccb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:56.353029 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d50a60eb-3739-4ec1-9037-0285d742ccb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:56.363049 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d50a60eb-3739-4ec1-9037-0285d742ccb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:56.363501 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d50a60eb-3739-4ec1-9037-0285d742ccb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:56.364262 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d50a60eb-3739-4ec1-9037-0285d742ccb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:56.364866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d50a60eb-3739-4ec1-9037-0285d742ccb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:56.398025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d50a60eb-3739-4ec1-9037-0285d742ccb5 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050458 May 26 17:05:56.400175 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 454/885] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:05:56 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:05:56.408907 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cfe33785-bfeb-4dd4-805c-6d554d34381b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:56.409395 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cfe33785-bfeb-4dd4-805c-6d554d34381b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:56.415558 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfe33785-bfeb-4dd4-805c-6d554d34381b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:56.416270 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfe33785-bfeb-4dd4-805c-6d554d34381b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:56.417623 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfe33785-bfeb-4dd4-805c-6d554d34381b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:56.418055 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cfe33785-bfeb-4dd4-805c-6d554d34381b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:56.574199 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-cfe33785-bfeb-4dd4-805c-6d554d34381b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] HTTP exception thrown: Instance d526ee14-28c1-46f0-97e9-37aecfc19059 is not attached to volume 9532b609-dcf3-4360-87af-f3c66640ca56 May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cfe33785-bfeb-4dd4-805c-6d554d34381b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Request method failure captured: May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: DELETE /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments/9532b609-dcf3-4360-87af-f3c66640ca56 HTTP/1.1 May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7H5j0AzUJyVe9GXMhIPV6gEhF0K27hoM6n-TIhrVWd7WZl_GqdBiWsv77N8oHlVeTnEDj0j3S1N6wkaNkZW1CQU7BxWzRi2-DPaBLVCt3BpWYeXfCg7vIYwMsvt9gd0SxLdrQ-ODCET8WFUuQfRncMZNGHBs3FefviALZevtn_1nG0 May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 3684109c25814f2dadd52c7f00d5e025 May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-TestMinimumBasicScenario-114898060 May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:05:56.582269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:05:56.583943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/3684109c25814f2dadd52c7f00d5e025"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/3684109c25814f2dadd52c7f00d5e025"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/3684109c25814f2dadd52c7f00d5e025"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_3684109c25814f2dadd52c7f00d5e025"}]}] May 26 17:05:56.583943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-TestMinimumBasicScenario-114898060 May 26 17:05:56.583943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 3684109c25814f2dadd52c7f00d5e025 May 26 17:05:56.583943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-TestMinimumBasicScenario-114898060 May 26 17:05:56.583943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-TestMinimumBasicScenario-114898060-project May 26 17:05:56.583943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:05:56.583943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:05:56.583943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 1f3a90c131984e8f8ab7b63679b39adc May 26 17:05:56.583943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-TestMinimumBasicScenario-114898060-project May 26 17:05:56.583943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:05:56.583943 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance d526ee14-28c1-46f0-97e9-37aecfc19059 is not attached to volume 9532b609-dcf3-4360-87af-f3c66640ca56 May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'server_id': 'd526ee14-28c1-46f0-97e9-37aecfc19059', 'id': '9532b609-dcf3-4360-87af-f3c66640ca56'} May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9532b609-dcf3-4360-87af-f3c66640ca56. May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:05:56.584723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d526ee14-28c1-46f0-97e9-37aecfc19059 is not attached to volume 9532b609-dcf3-4360-87af-f3c66640ca56 May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d526ee14-28c1-46f0-97e9-37aecfc19059 is not attached to volume 9532b609-dcf3-4360-87af-f3c66640ca56 May 26 17:05:56.586033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:05:56.592402 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cfe33785-bfeb-4dd4-805c-6d554d34381b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Returning 404 to user: Instance d526ee14-28c1-46f0-97e9-37aecfc19059 is not attached to volume 9532b609-dcf3-4360-87af-f3c66640ca56 {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:05:56.595828 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cfe33785-bfeb-4dd4-805c-6d554d34381b tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "DELETE /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments/9532b609-dcf3-4360-87af-f3c66640ca56" status: 404 len: 154 microversion: 2.1 time: 0.189267 May 26 17:05:56.601652 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 432/886] 10.222.0.112 () {58 vars in 1420 bytes} [Thu May 26 17:05:56 2022] DELETE /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059/os-volume_attachments/9532b609-dcf3-4360-87af-f3c66640ca56 => generated 154 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:05:56.622380 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2af12161-610e-475c-8b08-dc77bb7d7442 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: .version_select at 0x7fd250f23790>, body: {"keypair": {"name": "tempest-keypair-2089767892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+cwlD2V4bRHi7GNqJuQWGrsEFET8R4nca9RgXO1q5zyNZ2HjjDqelZ954nvDQl9X9OTr2j3JP66JRBTPkJa5QC//3NnsKaKX14XxfbSAdLmSFgXZECdX/LknnRKpo7yA=="}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:56.636883 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-2af12161-610e-475c-8b08-dc77bb7d7442 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'key_pairs'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:05:56.641023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-2af12161-610e-475c-8b08-dc77bb7d7442 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for user 289cb250e20344d28bd5fd17255d5896 and project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'key_pairs'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:05:56.743064 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2af12161-610e-475c-8b08-dc77bb7d7442 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124508 May 26 17:05:56.749362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 455/887] 10.222.0.112 () {60 vars in 1163 bytes} [Thu May 26 17:05:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:57.133223 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-70fbb1f2-3f29-4c48-9520-40c108c31685 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:57.133847 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-70fbb1f2-3f29-4c48-9520-40c108c31685 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:57.143759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-70fbb1f2-3f29-4c48-9520-40c108c31685 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:57.150615 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-70fbb1f2-3f29-4c48-9520-40c108c31685 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:57.150615 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-70fbb1f2-3f29-4c48-9520-40c108c31685 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:57.150615 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-70fbb1f2-3f29-4c48-9520-40c108c31685 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:57.281317 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-70fbb1f2-3f29-4c48-9520-40c108c31685 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:57.289831 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-70fbb1f2-3f29-4c48-9520-40c108c31685 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1728 microversion: 2.1 time: 0.160865 May 26 17:05:57.290426 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 433/888] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:57 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:57.923403 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8aa54ce7-b8c8-4ea4-af14-edcd07c53b73 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:57.923919 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8aa54ce7-b8c8-4ea4-af14-edcd07c53b73 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:57.930016 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8aa54ce7-b8c8-4ea4-af14-edcd07c53b73 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:57.930595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8aa54ce7-b8c8-4ea4-af14-edcd07c53b73 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:57.931403 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8aa54ce7-b8c8-4ea4-af14-edcd07c53b73 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:57.931845 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8aa54ce7-b8c8-4ea4-af14-edcd07c53b73 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:57.958658 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8aa54ce7-b8c8-4ea4-af14-edcd07c53b73 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Going to try to terminate instance {{(pid=130526) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:05:58.306313 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c9db96eb-9b7a-4c11-bb90-7c54c55e620c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:58.306918 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c9db96eb-9b7a-4c11-bb90-7c54c55e620c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:58.314096 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c9db96eb-9b7a-4c11-bb90-7c54c55e620c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:58.314585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c9db96eb-9b7a-4c11-bb90-7c54c55e620c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:58.315357 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c9db96eb-9b7a-4c11-bb90-7c54c55e620c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:58.315793 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c9db96eb-9b7a-4c11-bb90-7c54c55e620c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:58.318696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8aa54ce7-b8c8-4ea4-af14-edcd07c53b73 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "DELETE /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 204 len: 0 microversion: 2.1 time: 0.399387 May 26 17:05:58.319389 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 456/889] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:05:57 2022] DELETE /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:05:58.328850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c3a3bfa4-0abc-4ace-a583-6cc0ceaa3afb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:58.329548 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c3a3bfa4-0abc-4ace-a583-6cc0ceaa3afb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:58.335834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c3a3bfa4-0abc-4ace-a583-6cc0ceaa3afb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:58.336287 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c3a3bfa4-0abc-4ace-a583-6cc0ceaa3afb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:58.337059 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c3a3bfa4-0abc-4ace-a583-6cc0ceaa3afb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:58.337497 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c3a3bfa4-0abc-4ace-a583-6cc0ceaa3afb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:58.476001 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c9db96eb-9b7a-4c11-bb90-7c54c55e620c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:58.487658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c9db96eb-9b7a-4c11-bb90-7c54c55e620c tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1728 microversion: 2.1 time: 0.185359 May 26 17:05:58.488247 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 434/890] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:58 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:58.552765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c3a3bfa4-0abc-4ace-a583-6cc0ceaa3afb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:58.560751 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c3a3bfa4-0abc-4ace-a583-6cc0ceaa3afb tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1557 microversion: 2.1 time: 0.236054 May 26 17:05:58.561255 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 457/891] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:58 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1557 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:59.504993 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-de7ec1d2-89bf-4f46-8d23-174f6b1f98d2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:59.505656 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-de7ec1d2-89bf-4f46-8d23-174f6b1f98d2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:59.512093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de7ec1d2-89bf-4f46-8d23-174f6b1f98d2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:59.512535 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de7ec1d2-89bf-4f46-8d23-174f6b1f98d2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:59.513299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de7ec1d2-89bf-4f46-8d23-174f6b1f98d2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:59.513734 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de7ec1d2-89bf-4f46-8d23-174f6b1f98d2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:59.571414 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1547603000", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "685d481c-e3f1-425b-9a28-548fe43d099c"}], "security_groups": [{"name": "tempest-securitygroup--1069614629"}], "key_name": "tempest-keypair-2089767892", "user_data": "}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:59.653095 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-de7ec1d2-89bf-4f46-8d23-174f6b1f98d2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:59.661265 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-de7ec1d2-89bf-4f46-8d23-174f6b1f98d2 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1728 microversion: 2.1 time: 0.160248 May 26 17:05:59.661987 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 435/892] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:59 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:59.666811 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1cb4003b-c0d4-4c81-ba12-0fb20533a216 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:59.667438 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1cb4003b-c0d4-4c81-ba12-0fb20533a216 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:59.673353 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1cb4003b-c0d4-4c81-ba12-0fb20533a216 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:59.673809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1cb4003b-c0d4-4c81-ba12-0fb20533a216 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:59.674413 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.network.neutron [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] validate_networks() for [('685d481c-e3f1-425b-9a28-548fe43d099c', None, None, None, None, None)] {{(pid=130526) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:05:59.674615 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1cb4003b-c0d4-4c81-ba12-0fb20533a216 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:59.675055 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1cb4003b-c0d4-4c81-ba12-0fb20533a216 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:59.810398 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1cb4003b-c0d4-4c81-ba12-0fb20533a216 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:59.817997 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1cb4003b-c0d4-4c81-ba12-0fb20533a216 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1557 microversion: 2.1 time: 0.155006 May 26 17:05:59.818701 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 436/893] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:05:59 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:00.038035 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Flavor limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:06:00.038487 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Image limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:06:00.038963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Flavor pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:06:00.039370 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Image pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:06:00.039778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:06:00.049339 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:00.049793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:00.050638 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:00.051077 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:00.068019 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:06:00.071986 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for user 289cb250e20344d28bd5fd17255d5896 and project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:06:00.083116 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Going to run 1 instances... {{(pid=130526) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:06:00.085358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:06:00.253608 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1fe75d34-4652-49de-86e7-d7608580e66e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.686507 May 26 17:06:00.254464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 458/894] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:05:59 2022] POST /compute/v2.1/servers => generated 404 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 17:06:00.264609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-23e0633e-fa12-40ad-9a4d-272c1a18e381 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:00.265227 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-23e0633e-fa12-40ad-9a4d-272c1a18e381 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:00.320393 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-23e0633e-fa12-40ad-9a4d-272c1a18e381 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:00.327399 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-23e0633e-fa12-40ad-9a4d-272c1a18e381 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1246 microversion: 2.1 time: 0.066972 May 26 17:06:00.328082 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 437/895] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:00 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1246 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:00.678648 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4cb69d23-7216-47be-b9f7-457ccefbab23 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:00.679265 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4cb69d23-7216-47be-b9f7-457ccefbab23 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:00.681697 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:00.687211 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4cb69d23-7216-47be-b9f7-457ccefbab23 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:00.700366 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4cb69d23-7216-47be-b9f7-457ccefbab23 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:00.700366 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4cb69d23-7216-47be-b9f7-457ccefbab23 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:00.700366 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4cb69d23-7216-47be-b9f7-457ccefbab23 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:00.823420 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4cb69d23-7216-47be-b9f7-457ccefbab23 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:00.831734 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4cb69d23-7216-47be-b9f7-457ccefbab23 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1728 microversion: 2.1 time: 0.156798 May 26 17:06:00.832290 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 459/896] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:00 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:00.836594 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1135fdef-424f-4b5f-959c-f9ab3d51592f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:00.837211 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1135fdef-424f-4b5f-959c-f9ab3d51592f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:00.844735 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1135fdef-424f-4b5f-959c-f9ab3d51592f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:00.845184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1135fdef-424f-4b5f-959c-f9ab3d51592f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:00.845950 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1135fdef-424f-4b5f-959c-f9ab3d51592f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:00.846409 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1135fdef-424f-4b5f-959c-f9ab3d51592f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:00.976944 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1135fdef-424f-4b5f-959c-f9ab3d51592f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:00.984745 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1135fdef-424f-4b5f-959c-f9ab3d51592f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1557 microversion: 2.1 time: 0.152187 May 26 17:06:00.985302 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 438/897] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:00 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:06:01.345175 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0cc80eaf-b476-47f5-a099-75a573eafa37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:01.345789 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0cc80eaf-b476-47f5-a099-75a573eafa37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:01.351990 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0cc80eaf-b476-47f5-a099-75a573eafa37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:01.352441 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0cc80eaf-b476-47f5-a099-75a573eafa37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:01.353205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0cc80eaf-b476-47f5-a099-75a573eafa37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:01.353642 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0cc80eaf-b476-47f5-a099-75a573eafa37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:01.417126 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0cc80eaf-b476-47f5-a099-75a573eafa37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:01.424647 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0cc80eaf-b476-47f5-a099-75a573eafa37 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1250 microversion: 2.1 time: 0.083859 May 26 17:06:01.425216 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 460/898] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:01 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:01.849589 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ff70774a-56a2-42af-9c9e-712161751dcc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:01.850186 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ff70774a-56a2-42af-9c9e-712161751dcc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:01.857433 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ff70774a-56a2-42af-9c9e-712161751dcc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:01.857869 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ff70774a-56a2-42af-9c9e-712161751dcc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:01.858674 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ff70774a-56a2-42af-9c9e-712161751dcc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:01.859132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ff70774a-56a2-42af-9c9e-712161751dcc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:01.991901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ff70774a-56a2-42af-9c9e-712161751dcc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:02.000723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ff70774a-56a2-42af-9c9e-712161751dcc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1728 microversion: 2.1 time: 0.155099 May 26 17:06:02.001300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 439/899] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:01 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:02.003495 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-09a3409e-41fb-46c2-9d85-6c5f93debb4c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:02.004115 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-09a3409e-41fb-46c2-9d85-6c5f93debb4c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:02.011981 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-09a3409e-41fb-46c2-9d85-6c5f93debb4c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:02.012429 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-09a3409e-41fb-46c2-9d85-6c5f93debb4c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:02.013196 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-09a3409e-41fb-46c2-9d85-6c5f93debb4c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:02.013633 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-09a3409e-41fb-46c2-9d85-6c5f93debb4c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:02.143822 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-09a3409e-41fb-46c2-9d85-6c5f93debb4c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:02.151679 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-09a3409e-41fb-46c2-9d85-6c5f93debb4c tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1557 microversion: 2.1 time: 0.153107 May 26 17:06:02.152251 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 461/900] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:01 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:02.442267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9b1480d0-58b0-4887-8964-6493f0fc06e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:02.442824 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9b1480d0-58b0-4887-8964-6493f0fc06e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:02.449483 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9b1480d0-58b0-4887-8964-6493f0fc06e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:02.449936 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9b1480d0-58b0-4887-8964-6493f0fc06e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:02.450730 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9b1480d0-58b0-4887-8964-6493f0fc06e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:02.451169 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9b1480d0-58b0-4887-8964-6493f0fc06e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:02.518113 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9b1480d0-58b0-4887-8964-6493f0fc06e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:02.525423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9b1480d0-58b0-4887-8964-6493f0fc06e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1250 microversion: 2.1 time: 0.087165 May 26 17:06:02.526526 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 440/901] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:02 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:03.017311 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ea438f7a-5cb1-4ed8-b924-f0543f0a5987 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:03.017832 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ea438f7a-5cb1-4ed8-b924-f0543f0a5987 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:03.024430 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ea438f7a-5cb1-4ed8-b924-f0543f0a5987 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:03.024877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ea438f7a-5cb1-4ed8-b924-f0543f0a5987 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:03.025671 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ea438f7a-5cb1-4ed8-b924-f0543f0a5987 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:03.026121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ea438f7a-5cb1-4ed8-b924-f0543f0a5987 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:03.152692 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ea438f7a-5cb1-4ed8-b924-f0543f0a5987 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:03.160560 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ea438f7a-5cb1-4ed8-b924-f0543f0a5987 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1728 microversion: 2.1 time: 0.147184 May 26 17:06:03.161125 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 462/902] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:03 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:03.168532 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-15047bf3-bb6e-4579-9d23-76da0c633de9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:03.169264 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-15047bf3-bb6e-4579-9d23-76da0c633de9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:03.175833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-15047bf3-bb6e-4579-9d23-76da0c633de9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:03.176284 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-15047bf3-bb6e-4579-9d23-76da0c633de9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:03.177054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-15047bf3-bb6e-4579-9d23-76da0c633de9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:03.177489 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-15047bf3-bb6e-4579-9d23-76da0c633de9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:03.313340 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-15047bf3-bb6e-4579-9d23-76da0c633de9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:03.316967 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:03.321342 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-15047bf3-bb6e-4579-9d23-76da0c633de9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1557 microversion: 2.1 time: 0.157110 May 26 17:06:03.324267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 441/903] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:03 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:03.543264 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8c50c79e-6092-4e1c-81c6-d8edf61e4dd9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:03.543851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8c50c79e-6092-4e1c-81c6-d8edf61e4dd9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:03.549915 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8c50c79e-6092-4e1c-81c6-d8edf61e4dd9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:03.550395 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8c50c79e-6092-4e1c-81c6-d8edf61e4dd9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:03.551160 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8c50c79e-6092-4e1c-81c6-d8edf61e4dd9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:03.551594 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8c50c79e-6092-4e1c-81c6-d8edf61e4dd9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:03.616313 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8c50c79e-6092-4e1c-81c6-d8edf61e4dd9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:03.624213 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8c50c79e-6092-4e1c-81c6-d8edf61e4dd9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1250 microversion: 2.1 time: 0.085197 May 26 17:06:03.624778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 463/904] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:03 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:04.178507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f1e85de2-5db2-4645-867e-e13d8b527b39 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:04.179142 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f1e85de2-5db2-4645-867e-e13d8b527b39 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:04.186256 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f1e85de2-5db2-4645-867e-e13d8b527b39 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:04.186733 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f1e85de2-5db2-4645-867e-e13d8b527b39 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:04.187511 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f1e85de2-5db2-4645-867e-e13d8b527b39 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:04.187944 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f1e85de2-5db2-4645-867e-e13d8b527b39 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:04.318269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f1e85de2-5db2-4645-867e-e13d8b527b39 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:04.327108 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f1e85de2-5db2-4645-867e-e13d8b527b39 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1734 microversion: 2.1 time: 0.153064 May 26 17:06:04.327714 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 442/905] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:04 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:04.340075 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2a6d6d7a-cd72-4755-8e9e-b04dbe028797 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:04.340682 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2a6d6d7a-cd72-4755-8e9e-b04dbe028797 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:04.344440 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-12877640-32f4-4114-ac64-837a7d9b0de8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:04.344941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-12877640-32f4-4114-ac64-837a7d9b0de8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:04.347387 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2a6d6d7a-cd72-4755-8e9e-b04dbe028797 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:04.347831 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2a6d6d7a-cd72-4755-8e9e-b04dbe028797 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:04.348588 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2a6d6d7a-cd72-4755-8e9e-b04dbe028797 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:04.349013 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2a6d6d7a-cd72-4755-8e9e-b04dbe028797 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:04.350834 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-12877640-32f4-4114-ac64-837a7d9b0de8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:04.351292 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-12877640-32f4-4114-ac64-837a7d9b0de8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:04.352071 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-12877640-32f4-4114-ac64-837a7d9b0de8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:04.352507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-12877640-32f4-4114-ac64-837a7d9b0de8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:04.431529 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-12877640-32f4-4114-ac64-837a7d9b0de8 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090596 May 26 17:06:04.432148 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 443/906] 10.222.0.112 () {58 vars in 1279 bytes} [Thu May 26 17:06:04 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:06:04.481980 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2a6d6d7a-cd72-4755-8e9e-b04dbe028797 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:04.489834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2a6d6d7a-cd72-4755-8e9e-b04dbe028797 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1557 microversion: 2.1 time: 0.154383 May 26 17:06:04.491353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 464/907] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:04 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:04.642649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5886a6f9-a637-4cae-8d97-5e8bbcfb3bcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:04.643440 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5886a6f9-a637-4cae-8d97-5e8bbcfb3bcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:04.647580 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:04.652551 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5886a6f9-a637-4cae-8d97-5e8bbcfb3bcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:04.665688 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5886a6f9-a637-4cae-8d97-5e8bbcfb3bcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:04.665688 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5886a6f9-a637-4cae-8d97-5e8bbcfb3bcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:04.665688 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5886a6f9-a637-4cae-8d97-5e8bbcfb3bcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:04.738372 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5886a6f9-a637-4cae-8d97-5e8bbcfb3bcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:04.747238 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5886a6f9-a637-4cae-8d97-5e8bbcfb3bcd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1250 microversion: 2.1 time: 0.109504 May 26 17:06:04.747835 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 444/908] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:04 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1250 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:05.508540 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5379e5a5-c92f-4032-b5a3-79d2dd517433 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:05.509143 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5379e5a5-c92f-4032-b5a3-79d2dd517433 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:05.516352 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5379e5a5-c92f-4032-b5a3-79d2dd517433 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:05.516797 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5379e5a5-c92f-4032-b5a3-79d2dd517433 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:05.517566 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5379e5a5-c92f-4032-b5a3-79d2dd517433 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:05.518010 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5379e5a5-c92f-4032-b5a3-79d2dd517433 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:05.675693 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5379e5a5-c92f-4032-b5a3-79d2dd517433 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:05.686760 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-e5256009-8384-49d0-ad41-716f1f9b9a6a req-3ad15547-2c1f-45ba-99f3-c7dd94648288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea078281-ddf9-4637-9cfd-ca0709e2e74d", "tag": "43b6e144-5534-4897-b9ef-4e0176bc01ea"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:06:05.689629 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5379e5a5-c92f-4032-b5a3-79d2dd517433 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1557 microversion: 2.1 time: 0.184896 May 26 17:06:05.702192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-e5256009-8384-49d0-ad41-716f1f9b9a6a req-3ad15547-2c1f-45ba-99f3-c7dd94648288 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:05.702807 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-e5256009-8384-49d0-ad41-716f1f9b9a6a req-3ad15547-2c1f-45ba-99f3-c7dd94648288 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:05.703155 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 465/909] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:05 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1557 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:05.719071 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-e5256009-8384-49d0-ad41-716f1f9b9a6a req-3ad15547-2c1f-45ba-99f3-c7dd94648288 service nova] Creating event network-changed:43b6e144-5534-4897-b9ef-4e0176bc01ea for instance ea078281-ddf9-4637-9cfd-ca0709e2e74d on hv-cinder-83607 May 26 17:06:05.736612 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-e5256009-8384-49d0-ad41-716f1f9b9a6a req-3ad15547-2c1f-45ba-99f3-c7dd94648288 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043700 May 26 17:06:05.736612 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 445/910] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:06:05.764677 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c7b7b956-1b79-481e-a7a6-10278d2c9ec0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:05.765300 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c7b7b956-1b79-481e-a7a6-10278d2c9ec0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:05.771706 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c7b7b956-1b79-481e-a7a6-10278d2c9ec0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:05.772157 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c7b7b956-1b79-481e-a7a6-10278d2c9ec0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:05.772932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c7b7b956-1b79-481e-a7a6-10278d2c9ec0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:05.773374 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c7b7b956-1b79-481e-a7a6-10278d2c9ec0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:05.841410 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c7b7b956-1b79-481e-a7a6-10278d2c9ec0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:05.850301 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c7b7b956-1b79-481e-a7a6-10278d2c9ec0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1298 microversion: 2.1 time: 0.089516 May 26 17:06:05.853472 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 466/911] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:05 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:06:06.711578 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e97236f3-d00e-4d2b-80e9-bdd67ebda661 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:06.712311 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e97236f3-d00e-4d2b-80e9-bdd67ebda661 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:06.719128 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e97236f3-d00e-4d2b-80e9-bdd67ebda661 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:06.719570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e97236f3-d00e-4d2b-80e9-bdd67ebda661 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:06.720332 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e97236f3-d00e-4d2b-80e9-bdd67ebda661 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:06.720757 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e97236f3-d00e-4d2b-80e9-bdd67ebda661 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:06.794133 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e97236f3-d00e-4d2b-80e9-bdd67ebda661 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:06.802051 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e97236f3-d00e-4d2b-80e9-bdd67ebda661 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1515 microversion: 2.1 time: 0.097339 May 26 17:06:06.802666 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 446/912] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:06 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1515 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:06.869302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-98e2f760-e37c-4766-8e35-40be4e826af1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:06.870668 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-98e2f760-e37c-4766-8e35-40be4e826af1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:06.877292 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-98e2f760-e37c-4766-8e35-40be4e826af1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:06.877811 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-98e2f760-e37c-4766-8e35-40be4e826af1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:06.878635 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-98e2f760-e37c-4766-8e35-40be4e826af1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:06.879068 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-98e2f760-e37c-4766-8e35-40be4e826af1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:06.950154 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-98e2f760-e37c-4766-8e35-40be4e826af1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:06.958271 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-98e2f760-e37c-4766-8e35-40be4e826af1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1298 microversion: 2.1 time: 0.093096 May 26 17:06:06.959641 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 467/913] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:06 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:07.756092 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-6802e10f-b913-41bd-b1ed-8f8d88e98aed req-a90c3128-900b-4368-87ee-de23bdee4590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea078281-ddf9-4637-9cfd-ca0709e2e74d", "tag": "43b6e144-5534-4897-b9ef-4e0176bc01ea"}, {"server_uuid": "d526ee14-28c1-46f0-97e9-37aecfc19059", "name": "network-vif-deleted", "tag": "8f683af9-2af5-45b8-b6cb-ef44b939789d"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:06:07.766202 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-6802e10f-b913-41bd-b1ed-8f8d88e98aed req-a90c3128-900b-4368-87ee-de23bdee4590 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:07.766714 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-6802e10f-b913-41bd-b1ed-8f8d88e98aed req-a90c3128-900b-4368-87ee-de23bdee4590 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:07.779636 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-6802e10f-b913-41bd-b1ed-8f8d88e98aed req-a90c3128-900b-4368-87ee-de23bdee4590 service nova] Creating event network-changed:43b6e144-5534-4897-b9ef-4e0176bc01ea for instance ea078281-ddf9-4637-9cfd-ca0709e2e74d on hv-cinder-83607 May 26 17:06:07.780151 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-6802e10f-b913-41bd-b1ed-8f8d88e98aed req-a90c3128-900b-4368-87ee-de23bdee4590 service nova] Creating event network-vif-deleted:8f683af9-2af5-45b8-b6cb-ef44b939789d for instance d526ee14-28c1-46f0-97e9-37aecfc19059 on hv-cinder-83607 May 26 17:06:07.786557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-6802e10f-b913-41bd-b1ed-8f8d88e98aed req-a90c3128-900b-4368-87ee-de23bdee4590 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034359 May 26 17:06:07.787168 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 447/914] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:06:07.828391 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-41160d7c-3410-4280-8c4e-32848ee60c80 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:07.829109 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-41160d7c-3410-4280-8c4e-32848ee60c80 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:07.835924 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41160d7c-3410-4280-8c4e-32848ee60c80 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:07.836372 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41160d7c-3410-4280-8c4e-32848ee60c80 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:07.837140 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41160d7c-3410-4280-8c4e-32848ee60c80 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:07.837795 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41160d7c-3410-4280-8c4e-32848ee60c80 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:07.872640 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41160d7c-3410-4280-8c4e-32848ee60c80 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:07.873312 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41160d7c-3410-4280-8c4e-32848ee60c80 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:07.873995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-41160d7c-3410-4280-8c4e-32848ee60c80 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lazy-loading 'fault' on Instance uuid d526ee14-28c1-46f0-97e9-37aecfc19059 {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:06:07.925579 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-41160d7c-3410-4280-8c4e-32848ee60c80 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a90c131984e8f8ab7b63679b39adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3684109c25814f2dadd52c7f00d5e025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:07.934219 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-41160d7c-3410-4280-8c4e-32848ee60c80 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 200 len: 1351 microversion: 2.1 time: 0.109588 May 26 17:06:07.945305 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 468/915] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:07 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:07.976417 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-898ec068-91e5-4912-b3f4-89a7cbcb9edc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:07.981804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-898ec068-91e5-4912-b3f4-89a7cbcb9edc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:07.985180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-898ec068-91e5-4912-b3f4-89a7cbcb9edc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:07.985639 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-898ec068-91e5-4912-b3f4-89a7cbcb9edc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:07.986448 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-898ec068-91e5-4912-b3f4-89a7cbcb9edc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:07.986887 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-898ec068-91e5-4912-b3f4-89a7cbcb9edc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:08.060086 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-898ec068-91e5-4912-b3f4-89a7cbcb9edc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:08.067798 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-898ec068-91e5-4912-b3f4-89a7cbcb9edc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1304 microversion: 2.1 time: 0.095584 May 26 17:06:08.068368 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 448/916] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:07 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:08.953360 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b8831058-a4b4-4c79-bef1-3606c2437a0f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:08.953928 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b8831058-a4b4-4c79-bef1-3606c2437a0f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] [instance: d526ee14-28c1-46f0-97e9-37aecfc19059] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:08.961692 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b8831058-a4b4-4c79-bef1-3606c2437a0f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:08.962141 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b8831058-a4b4-4c79-bef1-3606c2437a0f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:08.963630 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b8831058-a4b4-4c79-bef1-3606c2437a0f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:08.964092 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b8831058-a4b4-4c79-bef1-3606c2437a0f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:08.969260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:08.978205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-b8831058-a4b4-4c79-bef1-3606c2437a0f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] HTTP exception thrown: Instance d526ee14-28c1-46f0-97e9-37aecfc19059 could not be found. May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b8831058-a4b4-4c79-bef1-3606c2437a0f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Request method failure captured: May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 HTTP/1.1 May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7H5j0AzUJyVe9GXMhIPV6gEhF0K27hoM6n-TIhrVWd7WZl_GqdBiWsv77N8oHlVeTnEDj0j3S1N6wkaNkZW1CQU7BxWzRi2-DPaBLVCt3BpWYeXfCg7vIYwMsvt9gd0SxLdrQ-ODCET8WFUuQfRncMZNGHBs3FefviALZevtn_1nG0 May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 3684109c25814f2dadd52c7f00d5e025 May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-TestMinimumBasicScenario-114898060 May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:06:08.980007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:06:08.981609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/3684109c25814f2dadd52c7f00d5e025"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/3684109c25814f2dadd52c7f00d5e025"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/3684109c25814f2dadd52c7f00d5e025"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_3684109c25814f2dadd52c7f00d5e025"}]}] May 26 17:06:08.981609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-TestMinimumBasicScenario-114898060 May 26 17:06:08.981609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 3684109c25814f2dadd52c7f00d5e025 May 26 17:06:08.981609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-TestMinimumBasicScenario-114898060 May 26 17:06:08.981609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-TestMinimumBasicScenario-114898060-project May 26 17:06:08.981609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:06:08.981609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:06:08.981609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 1f3a90c131984e8f8ab7b63679b39adc May 26 17:06:08.981609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-TestMinimumBasicScenario-114898060-project May 26 17:06:08.981609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:06:08.981609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance d526ee14-28c1-46f0-97e9-37aecfc19059 could not be found. May 26 17:06:08.981609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'd526ee14-28c1-46f0-97e9-37aecfc19059'} May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d526ee14-28c1-46f0-97e9-37aecfc19059 could not be found. May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:06:08.985586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d526ee14-28c1-46f0-97e9-37aecfc19059 could not be found. May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d526ee14-28c1-46f0-97e9-37aecfc19059 could not be found. May 26 17:06:08.986866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:06:08.987987 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b8831058-a4b4-4c79-bef1-3606c2437a0f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Returning 404 to user: Instance d526ee14-28c1-46f0-97e9-37aecfc19059 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:06:08.987987 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b8831058-a4b4-4c79-bef1-3606c2437a0f tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059" status: 404 len: 111 microversion: 2.1 time: 0.032292 May 26 17:06:08.987987 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 469/917] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:08 2022] GET /compute/v2.1/servers/d526ee14-28c1-46f0-97e9-37aecfc19059 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:06:08.990314 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e90fd1f8-2f9e-4f98-81e3-d96d7014fee9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] Calling method '.version_select at 0x7fd2513638b0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:09.085308 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e90fd1f8-2f9e-4f98-81e3-d96d7014fee9 tempest-TestMinimumBasicScenario-114898060 tempest-TestMinimumBasicScenario-114898060-project] 10.222.0.112 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-214547918" status: 202 len: 0 microversion: 2.1 time: 0.098973 May 26 17:06:09.085893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 449/918] 10.222.0.112 () {58 vars in 1273 bytes} [Thu May 26 17:06:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-214547918 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:06:09.087550 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-acea89a3-8775-4c1a-a1d6-33f617d4e96a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:09.088736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-acea89a3-8775-4c1a-a1d6-33f617d4e96a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:09.095964 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-acea89a3-8775-4c1a-a1d6-33f617d4e96a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:09.096494 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-acea89a3-8775-4c1a-a1d6-33f617d4e96a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:09.097539 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-acea89a3-8775-4c1a-a1d6-33f617d4e96a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:09.098050 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-acea89a3-8775-4c1a-a1d6-33f617d4e96a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:09.240522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-acea89a3-8775-4c1a-a1d6-33f617d4e96a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:09.249102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-acea89a3-8775-4c1a-a1d6-33f617d4e96a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1372 microversion: 2.1 time: 0.165990 May 26 17:06:09.249774 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 470/919] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:09 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:06:09.918173 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-eb747166-35dd-46fd-bcfc-cb981978c55e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:09.918760 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-eb747166-35dd-46fd-bcfc-cb981978c55e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:09.925002 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb747166-35dd-46fd-bcfc-cb981978c55e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:09.925454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb747166-35dd-46fd-bcfc-cb981978c55e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:09.926223 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb747166-35dd-46fd-bcfc-cb981978c55e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:09.926752 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb747166-35dd-46fd-bcfc-cb981978c55e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:09.958941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-eb747166-35dd-46fd-bcfc-cb981978c55e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments/a6a3fd2a-5c87-4783-83a9-a0246b8c86cc" status: 200 len: 194 microversion: 2.20 time: 0.045350 May 26 17:06:09.959572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 450/920] 10.222.0.112 () {60 vars in 1458 bytes} [Thu May 26 17:06:09 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments/a6a3fd2a-5c87-4783-83a9-a0246b8c86cc => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:06:09.971572 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-5089f4c5-6bdb-487b-9626-e15af7cac219 req-91cdd7e0-38b7-4da6-86c1-4f937baabaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb71ce55-ab15-4719-9bd9-3cf739fb322a", "tag": "c3955ac2-f683-4fbc-80a5-c28be909bd65"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:06:09.982223 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-5089f4c5-6bdb-487b-9626-e15af7cac219 req-91cdd7e0-38b7-4da6-86c1-4f937baabaa4 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:09.982842 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-5089f4c5-6bdb-487b-9626-e15af7cac219 req-91cdd7e0-38b7-4da6-86c1-4f937baabaa4 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:10.005543 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-5089f4c5-6bdb-487b-9626-e15af7cac219 req-91cdd7e0-38b7-4da6-86c1-4f937baabaa4 service nova] Creating event network-changed:c3955ac2-f683-4fbc-80a5-c28be909bd65 for instance bb71ce55-ab15-4719-9bd9-3cf739fb322a on hv-cinder-83607 May 26 17:06:10.011710 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-5089f4c5-6bdb-487b-9626-e15af7cac219 req-91cdd7e0-38b7-4da6-86c1-4f937baabaa4 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047341 May 26 17:06:10.013104 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 471/921] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:06:10.047534 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-25315874-2cbe-4a3c-a386-8e4e3590d94a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:10.048022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-25315874-2cbe-4a3c-a386-8e4e3590d94a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:10.056215 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-25315874-2cbe-4a3c-a386-8e4e3590d94a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:10.056978 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-25315874-2cbe-4a3c-a386-8e4e3590d94a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:10.057841 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-25315874-2cbe-4a3c-a386-8e4e3590d94a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:10.058280 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-25315874-2cbe-4a3c-a386-8e4e3590d94a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:10.170648 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-25315874-2cbe-4a3c-a386-8e4e3590d94a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lazy-loading 'services' on Instance uuid 79e5f6d0-3136-4741-a4c4-916b792ee1c8 {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:06:10.263864 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:10.276377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=10 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:10.283774 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bfb0aac2-397a-49b1-a82d-292dd3bd93d3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:10.285071 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bfb0aac2-397a-49b1-a82d-292dd3bd93d3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:10.292751 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bfb0aac2-397a-49b1-a82d-292dd3bd93d3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:10.293393 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bfb0aac2-397a-49b1-a82d-292dd3bd93d3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:10.294092 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bfb0aac2-397a-49b1-a82d-292dd3bd93d3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:10.294558 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bfb0aac2-397a-49b1-a82d-292dd3bd93d3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:10.324815 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:10.460902 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-25315874-2cbe-4a3c-a386-8e4e3590d94a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "DELETE /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments/a6a3fd2a-5c87-4783-83a9-a0246b8c86cc" status: 202 len: 0 microversion: 2.20 time: 0.417180 May 26 17:06:10.461504 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 451/922] 10.222.0.112 () {60 vars in 1461 bytes} [Thu May 26 17:06:10 2022] DELETE /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments/a6a3fd2a-5c87-4783-83a9-a0246b8c86cc => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 17:06:10.471063 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-bb910687-b159-40d9-a5b5-ae15a55c57ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:10.472677 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-bb910687-b159-40d9-a5b5-ae15a55c57ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:10.480585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bb910687-b159-40d9-a5b5-ae15a55c57ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:10.481346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bb910687-b159-40d9-a5b5-ae15a55c57ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:10.482401 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bb910687-b159-40d9-a5b5-ae15a55c57ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:10.483611 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bb910687-b159-40d9-a5b5-ae15a55c57ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:10.519050 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-bb910687-b159-40d9-a5b5-ae15a55c57ca tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052200 May 26 17:06:10.519883 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 452/923] 10.222.0.112 () {60 vars in 1347 bytes} [Thu May 26 17:06:10 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:06:10.653783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bfb0aac2-397a-49b1-a82d-292dd3bd93d3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:10.661926 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bfb0aac2-397a-49b1-a82d-292dd3bd93d3 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1372 microversion: 2.1 time: 0.398862 May 26 17:06:10.662534 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 472/924] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:10 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1372 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:11.530929 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7dd7b164-73ca-42fb-8b07-1d6ce19cbbd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:11.531970 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7dd7b164-73ca-42fb-8b07-1d6ce19cbbd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:11.539045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7dd7b164-73ca-42fb-8b07-1d6ce19cbbd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:11.539570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7dd7b164-73ca-42fb-8b07-1d6ce19cbbd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:11.540572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7dd7b164-73ca-42fb-8b07-1d6ce19cbbd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:11.541108 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7dd7b164-73ca-42fb-8b07-1d6ce19cbbd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:11.570284 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7dd7b164-73ca-42fb-8b07-1d6ce19cbbd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043735 May 26 17:06:11.571121 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 453/925] 10.222.0.112 () {60 vars in 1347 bytes} [Thu May 26 17:06:11 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:06:11.679967 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ee21c211-433e-43f3-97be-81b91ce603b9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:11.680754 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ee21c211-433e-43f3-97be-81b91ce603b9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:11.689381 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee21c211-433e-43f3-97be-81b91ce603b9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:11.689920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee21c211-433e-43f3-97be-81b91ce603b9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:11.691229 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee21c211-433e-43f3-97be-81b91ce603b9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:11.691740 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee21c211-433e-43f3-97be-81b91ce603b9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:11.832039 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ee21c211-433e-43f3-97be-81b91ce603b9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:11.840004 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ee21c211-433e-43f3-97be-81b91ce603b9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1372 microversion: 2.1 time: 0.163900 May 26 17:06:11.840639 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 473/926] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:11 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:12.583221 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e4117a16-87af-4a31-b0b9-82b828378bb5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:12.584167 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e4117a16-87af-4a31-b0b9-82b828378bb5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:12.591238 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e4117a16-87af-4a31-b0b9-82b828378bb5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:12.591688 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e4117a16-87af-4a31-b0b9-82b828378bb5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:12.592465 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e4117a16-87af-4a31-b0b9-82b828378bb5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:12.592898 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e4117a16-87af-4a31-b0b9-82b828378bb5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:12.625682 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e4117a16-87af-4a31-b0b9-82b828378bb5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047020 May 26 17:06:12.626273 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 454/927] 10.222.0.112 () {60 vars in 1347 bytes} [Thu May 26 17:06:12 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:06:12.864558 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ba8c4062-77c4-4a5f-8ce8-248f11c915a9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:12.864558 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ba8c4062-77c4-4a5f-8ce8-248f11c915a9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:12.865291 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba8c4062-77c4-4a5f-8ce8-248f11c915a9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:12.865556 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba8c4062-77c4-4a5f-8ce8-248f11c915a9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:12.866343 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba8c4062-77c4-4a5f-8ce8-248f11c915a9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:12.866788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba8c4062-77c4-4a5f-8ce8-248f11c915a9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:13.016697 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ba8c4062-77c4-4a5f-8ce8-248f11c915a9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:13.026752 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ba8c4062-77c4-4a5f-8ce8-248f11c915a9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1372 microversion: 2.1 time: 0.173170 May 26 17:06:13.029417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 474/928] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:12 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:13.637337 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0862d0e6-96e4-4740-8e50-fb75bb4e464d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:13.638251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0862d0e6-96e4-4740-8e50-fb75bb4e464d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:13.644819 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0862d0e6-96e4-4740-8e50-fb75bb4e464d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:13.645267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0862d0e6-96e4-4740-8e50-fb75bb4e464d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:13.646030 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0862d0e6-96e4-4740-8e50-fb75bb4e464d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:13.646501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0862d0e6-96e4-4740-8e50-fb75bb4e464d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:13.676906 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0862d0e6-96e4-4740-8e50-fb75bb4e464d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043523 May 26 17:06:13.677480 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 455/929] 10.222.0.112 () {60 vars in 1347 bytes} [Thu May 26 17:06:13 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:06:14.045772 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-922c5511-3dcb-4090-9b70-64114a14494b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:14.046609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-922c5511-3dcb-4090-9b70-64114a14494b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:14.053927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-922c5511-3dcb-4090-9b70-64114a14494b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:14.054534 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-922c5511-3dcb-4090-9b70-64114a14494b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:14.055411 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-922c5511-3dcb-4090-9b70-64114a14494b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:14.056053 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-922c5511-3dcb-4090-9b70-64114a14494b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:14.199069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-922c5511-3dcb-4090-9b70-64114a14494b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:14.208082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-922c5511-3dcb-4090-9b70-64114a14494b tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1372 microversion: 2.1 time: 0.166080 May 26 17:06:14.208668 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 475/930] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:14 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:06:14.689118 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d762d065-4c06-4820-a849-2ffe12d356a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:14.690069 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d762d065-4c06-4820-a849-2ffe12d356a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:14.696930 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d762d065-4c06-4820-a849-2ffe12d356a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:14.697438 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d762d065-4c06-4820-a849-2ffe12d356a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:14.698205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d762d065-4c06-4820-a849-2ffe12d356a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:14.698665 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d762d065-4c06-4820-a849-2ffe12d356a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:14.729510 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d762d065-4c06-4820-a849-2ffe12d356a1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044286 May 26 17:06:14.730080 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 456/931] 10.222.0.112 () {60 vars in 1347 bytes} [Thu May 26 17:06:14 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:06:15.232691 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7538f2ba-8a4d-4b66-9290-1ca5911449f0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:15.233206 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7538f2ba-8a4d-4b66-9290-1ca5911449f0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:15.239232 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7538f2ba-8a4d-4b66-9290-1ca5911449f0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:15.239675 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7538f2ba-8a4d-4b66-9290-1ca5911449f0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:15.240474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7538f2ba-8a4d-4b66-9290-1ca5911449f0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:15.240905 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7538f2ba-8a4d-4b66-9290-1ca5911449f0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:15.370619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7538f2ba-8a4d-4b66-9290-1ca5911449f0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:15.378757 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7538f2ba-8a4d-4b66-9290-1ca5911449f0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1372 microversion: 2.1 time: 0.155879 May 26 17:06:15.379337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 476/932] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:15 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:15.741553 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a66b15a8-a54b-4f44-a84c-a9711631daa5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:15.742495 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a66b15a8-a54b-4f44-a84c-a9711631daa5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:15.749422 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a66b15a8-a54b-4f44-a84c-a9711631daa5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:15.749864 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a66b15a8-a54b-4f44-a84c-a9711631daa5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:15.750852 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a66b15a8-a54b-4f44-a84c-a9711631daa5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:15.751285 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a66b15a8-a54b-4f44-a84c-a9711631daa5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:15.780177 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a66b15a8-a54b-4f44-a84c-a9711631daa5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042851 May 26 17:06:15.780740 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 457/933] 10.222.0.112 () {60 vars in 1347 bytes} [Thu May 26 17:06:15 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:15.853575 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-885dcea4-83bb-444f-8dd6-60991da0d84c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:15.854279 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-885dcea4-83bb-444f-8dd6-60991da0d84c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:15.860924 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-885dcea4-83bb-444f-8dd6-60991da0d84c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:15.861585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-885dcea4-83bb-444f-8dd6-60991da0d84c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:15.862362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-885dcea4-83bb-444f-8dd6-60991da0d84c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:15.862803 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-885dcea4-83bb-444f-8dd6-60991da0d84c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:15.893388 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-885dcea4-83bb-444f-8dd6-60991da0d84c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Going to try to terminate instance {{(pid=130526) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:06:16.335223 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-885dcea4-83bb-444f-8dd6-60991da0d84c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "DELETE /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 204 len: 0 microversion: 2.20 time: 0.485473 May 26 17:06:16.335972 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 477/934] 10.222.0.112 () {60 vars in 1284 bytes} [Thu May 26 17:06:15 2022] DELETE /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 17:06:16.348755 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3f6b14d5-43ee-476b-b5a9-abef47dd4a58 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:16.349360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3f6b14d5-43ee-476b-b5a9-abef47dd4a58 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:16.355327 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3f6b14d5-43ee-476b-b5a9-abef47dd4a58 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:16.355769 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3f6b14d5-43ee-476b-b5a9-abef47dd4a58 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:16.356704 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3f6b14d5-43ee-476b-b5a9-abef47dd4a58 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:16.357138 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3f6b14d5-43ee-476b-b5a9-abef47dd4a58 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:16.396748 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-308e4333-3022-4cc3-8865-6e4068ba93a8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:16.397454 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-308e4333-3022-4cc3-8865-6e4068ba93a8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:16.403936 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-308e4333-3022-4cc3-8865-6e4068ba93a8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:16.404324 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-308e4333-3022-4cc3-8865-6e4068ba93a8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:16.405089 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-308e4333-3022-4cc3-8865-6e4068ba93a8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:16.405522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-308e4333-3022-4cc3-8865-6e4068ba93a8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:16.542171 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-308e4333-3022-4cc3-8865-6e4068ba93a8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:16.549746 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-308e4333-3022-4cc3-8865-6e4068ba93a8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1372 microversion: 2.1 time: 0.157289 May 26 17:06:16.550368 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 478/935] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:16 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:16.581664 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3f6b14d5-43ee-476b-b5a9-abef47dd4a58 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:16.590002 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3f6b14d5-43ee-476b-b5a9-abef47dd4a58 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:16.591694 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3f6b14d5-43ee-476b-b5a9-abef47dd4a58 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:16.592982 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3f6b14d5-43ee-476b-b5a9-abef47dd4a58 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.248167 May 26 17:06:16.593546 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 458/936] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:16 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:17.568673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1c6002d6-0e4d-4ab8-be3c-a159891aca74 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:17.569233 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1c6002d6-0e4d-4ab8-be3c-a159891aca74 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:17.575985 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1c6002d6-0e4d-4ab8-be3c-a159891aca74 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:17.576437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1c6002d6-0e4d-4ab8-be3c-a159891aca74 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:17.577767 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1c6002d6-0e4d-4ab8-be3c-a159891aca74 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:17.577767 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1c6002d6-0e4d-4ab8-be3c-a159891aca74 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:17.624839 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-03d385c6-063b-46b9-8ada-9259bb5f617a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:17.627748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-03d385c6-063b-46b9-8ada-9259bb5f617a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:17.635872 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03d385c6-063b-46b9-8ada-9259bb5f617a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:17.636626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03d385c6-063b-46b9-8ada-9259bb5f617a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:17.637737 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03d385c6-063b-46b9-8ada-9259bb5f617a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:17.638415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03d385c6-063b-46b9-8ada-9259bb5f617a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:17.728995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1c6002d6-0e4d-4ab8-be3c-a159891aca74 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:17.737571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1c6002d6-0e4d-4ab8-be3c-a159891aca74 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1372 microversion: 2.1 time: 0.173495 May 26 17:06:17.738519 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 479/937] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:17 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:17.848688 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-03d385c6-063b-46b9-8ada-9259bb5f617a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:17.858136 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-03d385c6-063b-46b9-8ada-9259bb5f617a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:17.859782 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-03d385c6-063b-46b9-8ada-9259bb5f617a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:17.860958 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-03d385c6-063b-46b9-8ada-9259bb5f617a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.252888 May 26 17:06:17.861609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 459/938] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:17 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:18.756299 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ae390b15-be4a-4139-946e-5e201e12819a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:18.756933 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ae390b15-be4a-4139-946e-5e201e12819a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:18.766159 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ae390b15-be4a-4139-946e-5e201e12819a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:18.766676 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ae390b15-be4a-4139-946e-5e201e12819a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:18.767444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ae390b15-be4a-4139-946e-5e201e12819a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:18.768078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ae390b15-be4a-4139-946e-5e201e12819a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:18.879914 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-979ebf08-818e-4f90-8fe1-e8a082a2acb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:18.880800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-979ebf08-818e-4f90-8fe1-e8a082a2acb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:18.898910 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-979ebf08-818e-4f90-8fe1-e8a082a2acb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:18.899621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-979ebf08-818e-4f90-8fe1-e8a082a2acb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:18.901406 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-979ebf08-818e-4f90-8fe1-e8a082a2acb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:18.902063 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-979ebf08-818e-4f90-8fe1-e8a082a2acb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:18.919408 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ae390b15-be4a-4139-946e-5e201e12819a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:18.925154 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:18.927628 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ae390b15-be4a-4139-946e-5e201e12819a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1372 microversion: 2.1 time: 0.176134 May 26 17:06:18.928209 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 480/939] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:18 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:18.937100 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-11512168-6424-418b-843d-ac6f303eb1b2 req-3b082c5c-c9d9-4c78-8a73-00b508776279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb71ce55-ab15-4719-9bd9-3cf739fb322a", "name": "network-vif-plugged", "status": "completed", "tag": "c3955ac2-f683-4fbc-80a5-c28be909bd65"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:06:18.946164 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-11512168-6424-418b-843d-ac6f303eb1b2 req-3b082c5c-c9d9-4c78-8a73-00b508776279 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:18.947208 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-11512168-6424-418b-843d-ac6f303eb1b2 req-3b082c5c-c9d9-4c78-8a73-00b508776279 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:18.959239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-11512168-6424-418b-843d-ac6f303eb1b2 req-3b082c5c-c9d9-4c78-8a73-00b508776279 service nova] Creating event network-vif-plugged:c3955ac2-f683-4fbc-80a5-c28be909bd65 for instance bb71ce55-ab15-4719-9bd9-3cf739fb322a on hv-cinder-83607 May 26 17:06:18.964895 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-11512168-6424-418b-843d-ac6f303eb1b2 req-3b082c5c-c9d9-4c78-8a73-00b508776279 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031639 May 26 17:06:18.965488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 481/940] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:06:19.191232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-979ebf08-818e-4f90-8fe1-e8a082a2acb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:19.203488 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-979ebf08-818e-4f90-8fe1-e8a082a2acb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:19.206235 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-979ebf08-818e-4f90-8fe1-e8a082a2acb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:19.208197 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-979ebf08-818e-4f90-8fe1-e8a082a2acb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.332434 May 26 17:06:19.208989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 460/941] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:18 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:06:19.947669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-eab89d11-c0f3-4959-83a6-0232acc4296f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:19.953083 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-eab89d11-c0f3-4959-83a6-0232acc4296f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:19.955734 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eab89d11-c0f3-4959-83a6-0232acc4296f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:19.956276 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eab89d11-c0f3-4959-83a6-0232acc4296f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:19.957136 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eab89d11-c0f3-4959-83a6-0232acc4296f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:19.957664 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eab89d11-c0f3-4959-83a6-0232acc4296f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:20.102126 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-eab89d11-c0f3-4959-83a6-0232acc4296f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:20.110561 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-eab89d11-c0f3-4959-83a6-0232acc4296f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1372 microversion: 2.1 time: 0.169248 May 26 17:06:20.111140 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 482/942] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:19 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:06:20.226417 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e6cc1f11-4ec6-47bf-9d3d-232fecfd2b07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:20.227033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e6cc1f11-4ec6-47bf-9d3d-232fecfd2b07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:20.234891 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6cc1f11-4ec6-47bf-9d3d-232fecfd2b07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:20.239150 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6cc1f11-4ec6-47bf-9d3d-232fecfd2b07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:20.239150 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6cc1f11-4ec6-47bf-9d3d-232fecfd2b07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:20.239150 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6cc1f11-4ec6-47bf-9d3d-232fecfd2b07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:20.482677 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e6cc1f11-4ec6-47bf-9d3d-232fecfd2b07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:20.490618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e6cc1f11-4ec6-47bf-9d3d-232fecfd2b07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:20.492390 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e6cc1f11-4ec6-47bf-9d3d-232fecfd2b07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:20.494035 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e6cc1f11-4ec6-47bf-9d3d-232fecfd2b07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1727 microversion: 2.20 time: 0.271070 May 26 17:06:20.494709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 461/943] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:20 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1727 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:20.681911 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-c5899dd4-77e6-4e3b-98bd-f74aaeb1da81 req-e5ae8bf3-75ba-4306-b0df-d91fe395c53d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e5f6d0-3136-4741-a4c4-916b792ee1c8", "name": "network-vif-deleted", "tag": "bf8c749f-cafe-414f-850e-85d42f33c2db"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:06:20.699940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-c5899dd4-77e6-4e3b-98bd-f74aaeb1da81 req-e5ae8bf3-75ba-4306-b0df-d91fe395c53d service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:20.700385 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-c5899dd4-77e6-4e3b-98bd-f74aaeb1da81 req-e5ae8bf3-75ba-4306-b0df-d91fe395c53d service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:20.719270 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-c5899dd4-77e6-4e3b-98bd-f74aaeb1da81 req-e5ae8bf3-75ba-4306-b0df-d91fe395c53d service nova] Creating event network-vif-deleted:bf8c749f-cafe-414f-850e-85d42f33c2db for instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 on hv-cinder-83607 May 26 17:06:20.726436 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-c5899dd4-77e6-4e3b-98bd-f74aaeb1da81 req-e5ae8bf3-75ba-4306-b0df-d91fe395c53d service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048016 May 26 17:06:20.727891 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 483/944] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:06:21.127110 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c2020f53-d596-4023-b120-24a7f0c7a359 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:21.127711 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c2020f53-d596-4023-b120-24a7f0c7a359 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:21.133580 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c2020f53-d596-4023-b120-24a7f0c7a359 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:21.134571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c2020f53-d596-4023-b120-24a7f0c7a359 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:21.135671 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c2020f53-d596-4023-b120-24a7f0c7a359 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:21.136102 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c2020f53-d596-4023-b120-24a7f0c7a359 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:21.278624 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c2020f53-d596-4023-b120-24a7f0c7a359 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:21.286802 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c2020f53-d596-4023-b120-24a7f0c7a359 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1372 microversion: 2.1 time: 0.163883 May 26 17:06:21.290921 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 462/945] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:21 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:21.514712 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b24254b9-8442-48a8-88c8-33fe788e9da6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:21.516145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b24254b9-8442-48a8-88c8-33fe788e9da6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:21.522414 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b24254b9-8442-48a8-88c8-33fe788e9da6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:21.527069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b24254b9-8442-48a8-88c8-33fe788e9da6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:21.527069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b24254b9-8442-48a8-88c8-33fe788e9da6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:21.527069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b24254b9-8442-48a8-88c8-33fe788e9da6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:21.593364 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b24254b9-8442-48a8-88c8-33fe788e9da6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:21.602824 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b24254b9-8442-48a8-88c8-33fe788e9da6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:21.604567 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b24254b9-8442-48a8-88c8-33fe788e9da6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:21.605766 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b24254b9-8442-48a8-88c8-33fe788e9da6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1660 microversion: 2.20 time: 0.096826 May 26 17:06:21.606356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 484/946] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:21 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1660 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:22.307970 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-599d5852-ff4a-4a67-b7d3-dbe43da8d8e0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:22.308677 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-599d5852-ff4a-4a67-b7d3-dbe43da8d8e0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:22.315685 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-599d5852-ff4a-4a67-b7d3-dbe43da8d8e0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:22.316337 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-599d5852-ff4a-4a67-b7d3-dbe43da8d8e0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:22.317119 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-599d5852-ff4a-4a67-b7d3-dbe43da8d8e0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:22.317556 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-599d5852-ff4a-4a67-b7d3-dbe43da8d8e0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:22.474067 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-599d5852-ff4a-4a67-b7d3-dbe43da8d8e0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:22.481657 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-599d5852-ff4a-4a67-b7d3-dbe43da8d8e0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1372 microversion: 2.1 time: 0.178670 May 26 17:06:22.482269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 463/947] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:22 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:22.625772 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:22.626668 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:22.633299 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:22.633755 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:22.635043 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:22.635480 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:22.668826 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:22.669230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:22.669680 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lazy-loading 'fault' on Instance uuid 79e5f6d0-3136-4741-a4c4-916b792ee1c8 {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:06:22.710565 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:22.719037 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:22.720711 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:22.721877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6ce50134-5b94-4865-aef8-b56974676bfa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1376 microversion: 2.20 time: 0.101086 May 26 17:06:22.722481 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 485/948] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:22 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1376 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:23.499194 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3cc7e640-b4b2-4d13-9ca8-9149411b18cf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:23.499801 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3cc7e640-b4b2-4d13-9ca8-9149411b18cf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:23.506213 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3cc7e640-b4b2-4d13-9ca8-9149411b18cf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:23.506696 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3cc7e640-b4b2-4d13-9ca8-9149411b18cf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:23.507445 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3cc7e640-b4b2-4d13-9ca8-9149411b18cf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:23.507873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3cc7e640-b4b2-4d13-9ca8-9149411b18cf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:23.653570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3cc7e640-b4b2-4d13-9ca8-9149411b18cf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:23.661159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3cc7e640-b4b2-4d13-9ca8-9149411b18cf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1562 microversion: 2.1 time: 0.165783 May 26 17:06:23.661786 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 464/949] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:06:23 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:06:23.678479 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-77a52a54-f749-4bbf-9aea-70b0016f7cc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:23.679604 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-77a52a54-f749-4bbf-9aea-70b0016f7cc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:23.686859 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-77a52a54-f749-4bbf-9aea-70b0016f7cc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:23.687312 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-77a52a54-f749-4bbf-9aea-70b0016f7cc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:23.688090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-77a52a54-f749-4bbf-9aea-70b0016f7cc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:23.688533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-77a52a54-f749-4bbf-9aea-70b0016f7cc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:23.706532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:23.751209 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:23.752092 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:23.759951 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:23.760699 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:23.770906 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:23.770906 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:23.774084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-77a52a54-f749-4bbf-9aea-70b0016f7cc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099534 May 26 17:06:23.775308 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 486/950] 10.222.0.112 () {58 vars in 1279 bytes} [Thu May 26 17:06:23 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:06:23.802856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:23.803399 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:23.805250 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lazy-loading 'fault' on Instance uuid 79e5f6d0-3136-4741-a4c4-916b792ee1c8 {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:06:23.855041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:23.871126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:23.873273 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:23.875213 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cf520342-ceb5-49c5-a04d-f2a699fd2646 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 200 len: 1376 microversion: 2.20 time: 0.128062 May 26 17:06:23.876503 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 465/951] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:23 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 1376 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:24.896220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-59225781-e348-463a-a4db-7b6b9d0fe3e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:24.896841 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-59225781-e348-463a-a4db-7b6b9d0fe3e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:24.910365 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-59225781-e348-463a-a4db-7b6b9d0fe3e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:24.910365 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-59225781-e348-463a-a4db-7b6b9d0fe3e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:24.915473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-59225781-e348-463a-a4db-7b6b9d0fe3e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:24.918601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-59225781-e348-463a-a4db-7b6b9d0fe3e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:24.948543 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-cabee237-f7f3-43b0-b164-986a22d5a263 req-ae733506-dc98-4d7a-b431-a1ee2b06d609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb71ce55-ab15-4719-9bd9-3cf739fb322a", "tag": "c3955ac2-f683-4fbc-80a5-c28be909bd65"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:06:24.967929 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-59225781-e348-463a-a4db-7b6b9d0fe3e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] HTTP exception thrown: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:06:24.968800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-cabee237-f7f3-43b0-b164-986a22d5a263 req-ae733506-dc98-4d7a-b431-a1ee2b06d609 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:24.969522 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-cabee237-f7f3-43b0-b164-986a22d5a263 req-ae733506-dc98-4d7a-b431-a1ee2b06d609 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-59225781-e348-463a-a4db-7b6b9d0fe3e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Request method failure captured: May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 HTTP/1.1 May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GbzCgiZk59vHpDkcrPHVdJ6eBbq3ZN7mPQ_jki-Cnud1ZGJE-hnmfeAREoNiozhYPx5WjZvvBOlx0pN1ljf7ZQUCIPRYf_PqV44iAX8UC9LpMuGLkK_1XlkWtyYk5MJCcD2hYoGIuHDXSqIRkN3MGkUjNbjXAC1anwqPwQkkH1r0Q May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Openstack-Nova-Api-Version: 2.20 May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 0c9ae847a0d449ab9c875f8a4f936d6a May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:06:24.970948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:06:24.972437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_0c9ae847a0d449ab9c875f8a4f936d6a"}]}] May 26 17:06:24.972437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:06:24.972437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 0c9ae847a0d449ab9c875f8a4f936d6a May 26 17:06:24.972437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:06:24.972437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeShelveTestJSON-672346481-project May 26 17:06:24.972437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:06:24.972437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:06:24.972437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 9e09f6a92f064ec78231fa06782bafda May 26 17:06:24.972437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeShelveTestJSON-672346481-project May 26 17:06:24.972437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:06:24.972437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:06:24.972437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '79e5f6d0-3136-4741-a4c4-916b792ee1c8'} May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:06:24.973702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:06:24.976433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:06:24.979197 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-59225781-e348-463a-a4db-7b6b9d0fe3e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Returning 404 to user: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:06:24.979197 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-59225781-e348-463a-a4db-7b6b9d0fe3e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 404 len: 111 microversion: 2.20 time: 0.081692 May 26 17:06:24.983311 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 487/952] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:24 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 17:06:24.994965 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e0aed65a-9d5b-41a3-b6ee-0ef91639e865 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '.version_select at 0x7fd250f86ca0>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:25.005214 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-cabee237-f7f3-43b0-b164-986a22d5a263 req-ae733506-dc98-4d7a-b431-a1ee2b06d609 service nova] Creating event network-changed:c3955ac2-f683-4fbc-80a5-c28be909bd65 for instance bb71ce55-ab15-4719-9bd9-3cf739fb322a on hv-cinder-83607 May 26 17:06:25.017000 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-cabee237-f7f3-43b0-b164-986a22d5a263 req-ae733506-dc98-4d7a-b431-a1ee2b06d609 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076319 May 26 17:06:25.018026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 466/953] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:06:25.096720 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e0aed65a-9d5b-41a3-b6ee-0ef91639e865 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1421629834" status: 204 len: 0 microversion: 2.20 time: 0.108977 May 26 17:06:25.098003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 488/954] 10.222.0.112 () {60 vars in 1266 bytes} [Thu May 26 17:06:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1421629834 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 17:06:26.969775 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-04f51a58-0b4d-45a3-aa1b-08eefc22c572 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Action: 'create', calling method: .version_select at 0x7fd2510784c0>, body: {"keypair": {"name": "tempest-keypair-1176932179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJlkislyxvaIbyW3JNTWScuekMtE0pfXpBTmsAV0SB4TehrmEeiPo2cWmB+Eut/K8r/rJVTI1Vy35RfbRja9IhfeNJI1YFm5LfS4vKuJmIIeCcWF+jUZ+7e9jlZ0GVaHg=="}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:06:26.985120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-04f51a58-0b4d-45a3-aa1b-08eefc22c572 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Getting quotas for project 0c9ae847a0d449ab9c875f8a4f936d6a. Resources: {'key_pairs'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:06:26.991053 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-04f51a58-0b4d-45a3-aa1b-08eefc22c572 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Getting quotas for user 9e09f6a92f064ec78231fa06782bafda and project 0c9ae847a0d449ab9c875f8a4f936d6a. Resources: {'key_pairs'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:06:27.141339 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-04f51a58-0b4d-45a3-aa1b-08eefc22c572 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.177719 May 26 17:06:27.142474 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 467/955] 10.222.0.112 () {62 vars in 1204 bytes} [Thu May 26 17:06:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 17:06:30.475144 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1405533413", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5337a038-4616-4e5a-8535-a7a6c1c64f71"}], "security_groups": [{"name": "tempest-securitygroup--2147368480"}], "key_name": "tempest-keypair-1176932179", "user_data": "}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:06:30.612279 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.network.neutron [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] validate_networks() for [('5337a038-4616-4e5a-8535-a7a6c1c64f71', None, None, None, None, None)] {{(pid=130526) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:06:31.179836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Flavor limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:06:31.180735 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Image limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:06:31.181568 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Flavor pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:06:31.182299 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Image pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:06:31.182912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:06:31.196451 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:31.197106 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:31.203651 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:31.203651 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:31.223484 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Getting quotas for project 0c9ae847a0d449ab9c875f8a4f936d6a. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:06:31.229852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Getting quotas for user 9e09f6a92f064ec78231fa06782bafda and project 0c9ae847a0d449ab9c875f8a4f936d6a. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:06:31.247241 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Going to run 1 instances... {{(pid=130526) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:06:31.249761 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:06:31.427956 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-21afc32a-5c26-41f3-917b-8d8438617f2e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.957165 May 26 17:06:31.429276 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 489/956] 10.222.0.112 () {62 vars in 1192 bytes} [Thu May 26 17:06:30 2022] POST /compute/v2.1/servers => generated 404 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 26 17:06:31.439676 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4e3fe9db-33a8-44e5-94ba-ae75a4411e95 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:31.441180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4e3fe9db-33a8-44e5-94ba-ae75a4411e95 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:31.507259 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4e3fe9db-33a8-44e5-94ba-ae75a4411e95 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:31.517835 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4e3fe9db-33a8-44e5-94ba-ae75a4411e95 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:31.522041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4e3fe9db-33a8-44e5-94ba-ae75a4411e95 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:31.523587 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4e3fe9db-33a8-44e5-94ba-ae75a4411e95 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1286 microversion: 2.20 time: 0.088492 May 26 17:06:31.534920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 468/957] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:31 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:32.544888 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9d448352-e25f-4ad5-bb7d-7b0c3ecf2462 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:32.545761 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9d448352-e25f-4ad5-bb7d-7b0c3ecf2462 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:32.554838 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:32.630356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9d448352-e25f-4ad5-bb7d-7b0c3ecf2462 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:32.639435 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9d448352-e25f-4ad5-bb7d-7b0c3ecf2462 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:32.641962 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9d448352-e25f-4ad5-bb7d-7b0c3ecf2462 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:32.643544 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9d448352-e25f-4ad5-bb7d-7b0c3ecf2462 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1286 microversion: 2.20 time: 0.104224 May 26 17:06:32.644285 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 490/958] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:32 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:06:33.664385 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a294498b-1911-44a8-8a53-893facaadb90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:33.666298 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a294498b-1911-44a8-8a53-893facaadb90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:33.674909 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a294498b-1911-44a8-8a53-893facaadb90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:33.675765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a294498b-1911-44a8-8a53-893facaadb90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:33.676735 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a294498b-1911-44a8-8a53-893facaadb90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:33.677173 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a294498b-1911-44a8-8a53-893facaadb90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:33.750502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a294498b-1911-44a8-8a53-893facaadb90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:33.759937 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a294498b-1911-44a8-8a53-893facaadb90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:33.761828 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a294498b-1911-44a8-8a53-893facaadb90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:33.763173 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a294498b-1911-44a8-8a53-893facaadb90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1338 microversion: 2.20 time: 0.102670 May 26 17:06:33.764147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 469/959] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:33 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:34.784514 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-cdaeaaaa-a5cf-4a70-b6d0-2ff9ca8fcd5e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:34.786687 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-cdaeaaaa-a5cf-4a70-b6d0-2ff9ca8fcd5e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:34.807673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cdaeaaaa-a5cf-4a70-b6d0-2ff9ca8fcd5e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:34.808500 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cdaeaaaa-a5cf-4a70-b6d0-2ff9ca8fcd5e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:34.809520 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cdaeaaaa-a5cf-4a70-b6d0-2ff9ca8fcd5e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:34.811697 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cdaeaaaa-a5cf-4a70-b6d0-2ff9ca8fcd5e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:34.912577 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cdaeaaaa-a5cf-4a70-b6d0-2ff9ca8fcd5e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:34.924283 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cdaeaaaa-a5cf-4a70-b6d0-2ff9ca8fcd5e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:34.926097 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cdaeaaaa-a5cf-4a70-b6d0-2ff9ca8fcd5e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:34.927511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-cdaeaaaa-a5cf-4a70-b6d0-2ff9ca8fcd5e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1346 microversion: 2.20 time: 0.150223 May 26 17:06:34.928248 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 491/960] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:34 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1346 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:35.946741 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a03af193-acef-409b-82eb-f6dd77eb862d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:35.947349 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a03af193-acef-409b-82eb-f6dd77eb862d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:35.954923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a03af193-acef-409b-82eb-f6dd77eb862d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:35.955383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a03af193-acef-409b-82eb-f6dd77eb862d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:35.956697 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a03af193-acef-409b-82eb-f6dd77eb862d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:35.957210 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a03af193-acef-409b-82eb-f6dd77eb862d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:36.106547 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a03af193-acef-409b-82eb-f6dd77eb862d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:36.114605 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a03af193-acef-409b-82eb-f6dd77eb862d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:36.116155 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a03af193-acef-409b-82eb-f6dd77eb862d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:36.117304 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a03af193-acef-409b-82eb-f6dd77eb862d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1412 microversion: 2.20 time: 0.174621 May 26 17:06:36.124854 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 470/961] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:35 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1412 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:37.137496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9641bd48-cad9-4801-acee-c80dce58df11 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:37.138856 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9641bd48-cad9-4801-acee-c80dce58df11 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:37.157246 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9641bd48-cad9-4801-acee-c80dce58df11 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:37.158632 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9641bd48-cad9-4801-acee-c80dce58df11 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:37.161585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9641bd48-cad9-4801-acee-c80dce58df11 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:37.162282 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9641bd48-cad9-4801-acee-c80dce58df11 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:37.429235 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9641bd48-cad9-4801-acee-c80dce58df11 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:37.439483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9641bd48-cad9-4801-acee-c80dce58df11 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:37.441719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9641bd48-cad9-4801-acee-c80dce58df11 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:37.443129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9641bd48-cad9-4801-acee-c80dce58df11 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1412 microversion: 2.20 time: 0.310881 May 26 17:06:37.443690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 492/962] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:37 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1412 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:37.521510 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-3fe50584-a95a-47ef-bec7-491986a664d1 req-4516f14d-680b-4797-8cb7-fb5ea8bcc0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dca66e2-797a-492c-aa32-e2bb881ac25b", "tag": "4e63cdc0-f462-4b50-8bc7-40551bf2f0ba"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:06:37.534473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-3fe50584-a95a-47ef-bec7-491986a664d1 req-4516f14d-680b-4797-8cb7-fb5ea8bcc0d5 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:37.535853 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-3fe50584-a95a-47ef-bec7-491986a664d1 req-4516f14d-680b-4797-8cb7-fb5ea8bcc0d5 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:37.561453 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-3fe50584-a95a-47ef-bec7-491986a664d1 req-4516f14d-680b-4797-8cb7-fb5ea8bcc0d5 service nova] Creating event network-changed:4e63cdc0-f462-4b50-8bc7-40551bf2f0ba for instance 4dca66e2-797a-492c-aa32-e2bb881ac25b on hv-cinder-83607 May 26 17:06:37.575761 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-3fe50584-a95a-47ef-bec7-491986a664d1 req-4516f14d-680b-4797-8cb7-fb5ea8bcc0d5 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064024 May 26 17:06:37.577128 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 493/963] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:06:37.852343 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9936e13b-c531-4461-9b0d-5a14f5abdb7d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Action: 'create', calling method: .version_select at 0x7fd2511cfa60>, body: {"keypair": {"name": "tempest-TestShelveInstance-435658207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0Qupiq/gl/eO14JEpLRw8MVJlaC0F5lf5THs4zAe+d5odSDnvOo1SNiwAHgrAP0SboQK+1cX21cGSmQMM0+XHztrSJqqCok4pgmxGjssCufV2yUkuE3yXTt875iY+cTQ=="}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:06:37.856897 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:37.869146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-9936e13b-c531-4461-9b0d-5a14f5abdb7d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Getting quotas for project ac969ae313524a28b6635d82db310f97. Resources: {'key_pairs'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:06:37.873171 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-9936e13b-c531-4461-9b0d-5a14f5abdb7d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Getting quotas for user caebb88017f94b25bbbac26be1218bc3 and project ac969ae313524a28b6635d82db310f97. Resources: {'key_pairs'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:06:37.993454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9936e13b-c531-4461-9b0d-5a14f5abdb7d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.566468 May 26 17:06:37.997495 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 471/964] 10.222.0.112 () {60 vars in 1163 bytes} [Thu May 26 17:06:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:06:38.464530 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7a9c9139-f57f-46ee-be66-76f3e01ad606 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:38.468015 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7a9c9139-f57f-46ee-be66-76f3e01ad606 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:38.474591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a9c9139-f57f-46ee-be66-76f3e01ad606 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:38.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a9c9139-f57f-46ee-be66-76f3e01ad606 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:38.476351 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a9c9139-f57f-46ee-be66-76f3e01ad606 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:38.477722 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a9c9139-f57f-46ee-be66-76f3e01ad606 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:38.646278 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7a9c9139-f57f-46ee-be66-76f3e01ad606 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:38.657718 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7a9c9139-f57f-46ee-be66-76f3e01ad606 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:38.659545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7a9c9139-f57f-46ee-be66-76f3e01ad606 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:38.660894 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7a9c9139-f57f-46ee-be66-76f3e01ad606 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1412 microversion: 2.20 time: 0.202311 May 26 17:06:38.661455 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 494/965] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:38 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1412 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:39.681575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4c15dc3f-60f3-4934-9df1-fdf15655799d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:39.682360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4c15dc3f-60f3-4934-9df1-fdf15655799d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:39.689976 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4c15dc3f-60f3-4934-9df1-fdf15655799d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:39.690475 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4c15dc3f-60f3-4934-9df1-fdf15655799d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:39.691244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4c15dc3f-60f3-4934-9df1-fdf15655799d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:39.691685 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4c15dc3f-60f3-4934-9df1-fdf15655799d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:39.824631 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4c15dc3f-60f3-4934-9df1-fdf15655799d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:39.832826 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4c15dc3f-60f3-4934-9df1-fdf15655799d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:39.834355 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4c15dc3f-60f3-4934-9df1-fdf15655799d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:39.835460 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4c15dc3f-60f3-4934-9df1-fdf15655799d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1412 microversion: 2.20 time: 0.159440 May 26 17:06:39.836037 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 472/966] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:39 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:40.853672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2562b578-0a86-436a-8cc9-602cfb3a3e35 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:40.854290 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2562b578-0a86-436a-8cc9-602cfb3a3e35 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:40.866788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2562b578-0a86-436a-8cc9-602cfb3a3e35 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:40.867152 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2562b578-0a86-436a-8cc9-602cfb3a3e35 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:40.868695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2562b578-0a86-436a-8cc9-602cfb3a3e35 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:40.869448 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2562b578-0a86-436a-8cc9-602cfb3a3e35 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:41.016339 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2562b578-0a86-436a-8cc9-602cfb3a3e35 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:41.025366 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2562b578-0a86-436a-8cc9-602cfb3a3e35 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:41.027682 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2562b578-0a86-436a-8cc9-602cfb3a3e35 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:41.036370 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2562b578-0a86-436a-8cc9-602cfb3a3e35 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1412 microversion: 2.20 time: 0.180510 May 26 17:06:41.036370 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 495/967] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:40 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1412 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:42.048706 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-305568f4-9f49-4f84-959f-642a76ea719c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:42.049377 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-305568f4-9f49-4f84-959f-642a76ea719c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:42.057322 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-305568f4-9f49-4f84-959f-642a76ea719c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:42.057764 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-305568f4-9f49-4f84-959f-642a76ea719c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:42.058577 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-305568f4-9f49-4f84-959f-642a76ea719c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:42.059009 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-305568f4-9f49-4f84-959f-642a76ea719c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:42.198661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-305568f4-9f49-4f84-959f-642a76ea719c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:42.207074 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-305568f4-9f49-4f84-959f-642a76ea719c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:42.208580 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-305568f4-9f49-4f84-959f-642a76ea719c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:42.209694 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-305568f4-9f49-4f84-959f-642a76ea719c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1412 microversion: 2.20 time: 0.164931 May 26 17:06:42.210251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 473/968] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:42 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1412 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:43.228553 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8dd9a0b4-3d98-41c3-8b5a-313226e3a1bd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:43.229145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8dd9a0b4-3d98-41c3-8b5a-313226e3a1bd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:43.231093 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:43.232231 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=8 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:43.237026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8dd9a0b4-3d98-41c3-8b5a-313226e3a1bd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:43.237474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8dd9a0b4-3d98-41c3-8b5a-313226e3a1bd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:43.238245 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8dd9a0b4-3d98-41c3-8b5a-313226e3a1bd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:43.238708 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8dd9a0b4-3d98-41c3-8b5a-313226e3a1bd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:43.387029 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8dd9a0b4-3d98-41c3-8b5a-313226e3a1bd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:43.394818 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8dd9a0b4-3d98-41c3-8b5a-313226e3a1bd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:43.396307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8dd9a0b4-3d98-41c3-8b5a-313226e3a1bd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:43.397403 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8dd9a0b4-3d98-41c3-8b5a-313226e3a1bd tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1412 microversion: 2.20 time: 0.173398 May 26 17:06:43.397963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 496/969] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:43 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1412 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:44.415556 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-48e3956b-e037-44c2-b362-af4993d25015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:44.416290 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-48e3956b-e037-44c2-b362-af4993d25015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:44.423510 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-48e3956b-e037-44c2-b362-af4993d25015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:44.424120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-48e3956b-e037-44c2-b362-af4993d25015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:44.424885 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-48e3956b-e037-44c2-b362-af4993d25015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:44.425311 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-48e3956b-e037-44c2-b362-af4993d25015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:44.559518 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-48e3956b-e037-44c2-b362-af4993d25015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:44.567319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-48e3956b-e037-44c2-b362-af4993d25015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:44.568793 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-48e3956b-e037-44c2-b362-af4993d25015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:44.569885 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-48e3956b-e037-44c2-b362-af4993d25015 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1412 microversion: 2.20 time: 0.159035 May 26 17:06:44.571179 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 474/970] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:44 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:45.588948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1456e68f-96a9-4a76-a87e-bb52d828fed5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:45.589548 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1456e68f-96a9-4a76-a87e-bb52d828fed5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:45.596376 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1456e68f-96a9-4a76-a87e-bb52d828fed5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:45.596818 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1456e68f-96a9-4a76-a87e-bb52d828fed5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:45.597566 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1456e68f-96a9-4a76-a87e-bb52d828fed5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:45.598089 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1456e68f-96a9-4a76-a87e-bb52d828fed5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:45.730143 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1456e68f-96a9-4a76-a87e-bb52d828fed5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:45.738102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1456e68f-96a9-4a76-a87e-bb52d828fed5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:45.739676 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1456e68f-96a9-4a76-a87e-bb52d828fed5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:45.740789 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1456e68f-96a9-4a76-a87e-bb52d828fed5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1412 microversion: 2.20 time: 0.156214 May 26 17:06:45.741349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 497/971] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:45 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1412 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:46.052221 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-d258b0a1-da97-42af-94df-6a7576f6543a req-8f3661a6-2481-4963-87b9-f9f0120332e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dca66e2-797a-492c-aa32-e2bb881ac25b", "name": "network-vif-plugged", "status": "completed", "tag": "4e63cdc0-f462-4b50-8bc7-40551bf2f0ba"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:06:46.061053 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-d258b0a1-da97-42af-94df-6a7576f6543a req-8f3661a6-2481-4963-87b9-f9f0120332e9 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:46.061495 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-d258b0a1-da97-42af-94df-6a7576f6543a req-8f3661a6-2481-4963-87b9-f9f0120332e9 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:46.072444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-d258b0a1-da97-42af-94df-6a7576f6543a req-8f3661a6-2481-4963-87b9-f9f0120332e9 service nova] Creating event network-vif-plugged:4e63cdc0-f462-4b50-8bc7-40551bf2f0ba for instance 4dca66e2-797a-492c-aa32-e2bb881ac25b on hv-cinder-83607 May 26 17:06:46.077556 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-d258b0a1-da97-42af-94df-6a7576f6543a req-8f3661a6-2481-4963-87b9-f9f0120332e9 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029069 May 26 17:06:46.078205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 475/972] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:06:46.760261 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a7522735-018d-4377-86bf-e2d17aaabe2c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:46.760813 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a7522735-018d-4377-86bf-e2d17aaabe2c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:46.767266 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a7522735-018d-4377-86bf-e2d17aaabe2c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:46.767714 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a7522735-018d-4377-86bf-e2d17aaabe2c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:46.768475 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a7522735-018d-4377-86bf-e2d17aaabe2c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:46.768909 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a7522735-018d-4377-86bf-e2d17aaabe2c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:47.124339 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a7522735-018d-4377-86bf-e2d17aaabe2c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:47.134400 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a7522735-018d-4377-86bf-e2d17aaabe2c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:47.136452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a7522735-018d-4377-86bf-e2d17aaabe2c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:47.137617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a7522735-018d-4377-86bf-e2d17aaabe2c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1412 microversion: 2.20 time: 0.382734 May 26 17:06:47.138177 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 498/973] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:46 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1412 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:48.153620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=10 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:48.157862 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a8f53396-046d-43ed-92b3-28a96bf3c98b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:48.158618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a8f53396-046d-43ed-92b3-28a96bf3c98b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:48.166784 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a8f53396-046d-43ed-92b3-28a96bf3c98b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:48.167242 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a8f53396-046d-43ed-92b3-28a96bf3c98b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:48.168037 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a8f53396-046d-43ed-92b3-28a96bf3c98b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:48.168471 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a8f53396-046d-43ed-92b3-28a96bf3c98b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:48.303434 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a8f53396-046d-43ed-92b3-28a96bf3c98b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:48.312385 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a8f53396-046d-43ed-92b3-28a96bf3c98b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:48.313995 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a8f53396-046d-43ed-92b3-28a96bf3c98b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:48.315147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a8f53396-046d-43ed-92b3-28a96bf3c98b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1412 microversion: 2.20 time: 0.163224 May 26 17:06:48.315749 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 476/974] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:48 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:49.336830 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a684498e-ea1f-471a-86f1-83d05d50ca6c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:49.338126 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a684498e-ea1f-471a-86f1-83d05d50ca6c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:49.344665 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a684498e-ea1f-471a-86f1-83d05d50ca6c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:49.345108 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a684498e-ea1f-471a-86f1-83d05d50ca6c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:49.345866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a684498e-ea1f-471a-86f1-83d05d50ca6c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:49.346299 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a684498e-ea1f-471a-86f1-83d05d50ca6c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:49.483145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a684498e-ea1f-471a-86f1-83d05d50ca6c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:49.491970 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a684498e-ea1f-471a-86f1-83d05d50ca6c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:49.495644 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a684498e-ea1f-471a-86f1-83d05d50ca6c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:06:49.496837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a684498e-ea1f-471a-86f1-83d05d50ca6c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1604 microversion: 2.20 time: 0.164951 May 26 17:06:49.497584 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 499/975] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:06:49 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1604 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:06:49.514116 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-75c69090-7545-4b59-a24b-ed1a8766a4e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:06:49.514665 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-75c69090-7545-4b59-a24b-ed1a8766a4e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:06:49.521027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75c69090-7545-4b59-a24b-ed1a8766a4e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:49.521475 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75c69090-7545-4b59-a24b-ed1a8766a4e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:49.522239 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75c69090-7545-4b59-a24b-ed1a8766a4e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:49.522700 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75c69090-7545-4b59-a24b-ed1a8766a4e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:49.602125 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-75c69090-7545-4b59-a24b-ed1a8766a4e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091295 May 26 17:06:49.602757 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 477/976] 10.222.0.112 () {60 vars in 1320 bytes} [Thu May 26 17:06:49 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:06:50.868799 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-f331ab68-82e3-433c-b4cb-47768457ef5a req-6481853c-3865-429c-907a-95c47c58dbda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dca66e2-797a-492c-aa32-e2bb881ac25b", "tag": "4e63cdc0-f462-4b50-8bc7-40551bf2f0ba"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:06:50.877294 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-f331ab68-82e3-433c-b4cb-47768457ef5a req-6481853c-3865-429c-907a-95c47c58dbda service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:06:50.877739 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-f331ab68-82e3-433c-b4cb-47768457ef5a req-6481853c-3865-429c-907a-95c47c58dbda service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:06:50.889653 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-f331ab68-82e3-433c-b4cb-47768457ef5a req-6481853c-3865-429c-907a-95c47c58dbda service nova] Creating event network-changed:4e63cdc0-f462-4b50-8bc7-40551bf2f0ba for instance 4dca66e2-797a-492c-aa32-e2bb881ac25b on hv-cinder-83607 May 26 17:06:50.894825 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-f331ab68-82e3-433c-b4cb-47768457ef5a req-6481853c-3865-429c-907a-95c47c58dbda service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029706 May 26 17:06:50.895643 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 500/977] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:07:12.471404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:12.472247 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=78 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:12.476826 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1483375435", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-435658207", "security_groups": [{"name": "tempest-secgroup-smoke-582275441"}], "networks": [{"uuid": "1faadc9b-a9db-42a8-bbe0-b7ff0f07b246"}], "block_device_mapping_v2": [{"uuid": "18f31175-9e14-484d-b260-a731ac917e56", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:07:12.596633 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] validate_networks() for [('1faadc9b-a9db-42a8-bbe0-b7ff0f07b246', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:07:13.051761 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:07:13.052178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:07:13.052645 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:07:13.053660 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:07:13.054338 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:07:13.063313 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:13.063754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:13.064544 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:13.064970 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:13.082781 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Getting quotas for project ac969ae313524a28b6635d82db310f97. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:07:13.086940 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Getting quotas for user caebb88017f94b25bbbac26be1218bc3 and project ac969ae313524a28b6635d82db310f97. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:07:13.142949 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:07:13.145026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18f31175-9e14-484d-b260-a731ac917e56',volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:07:13.583245 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR oslo.messaging._drivers.impl_rabbit [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [9c588fc4-53ba-428c-a082-be846ef1ed73] AMQP server on 10.222.0.112:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 17:07:14.591553 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO oslo.messaging._drivers.impl_rabbit [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [9c588fc4-53ba-428c-a082-be846ef1ed73] Reconnected to AMQP server on 10.222.0.112:5672 via [amqp] client with port 60884. May 26 17:07:14.595284 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-da028e97-a851-4623-9347-c516fa615029 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.125329 May 26 17:07:14.595947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 478/978] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:07:12 2022] POST /compute/v2.1/servers => generated 407 bytes in 2127 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:07:14.605984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=23 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:14.607365 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=56 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:14.613030 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-cbb8e910-2da2-4b6c-8290-cab3b97a8e55 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:14.613734 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-cbb8e910-2da2-4b6c-8290-cab3b97a8e55 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:14.668017 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cbb8e910-2da2-4b6c-8290-cab3b97a8e55 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:14.674694 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-cbb8e910-2da2-4b6c-8290-cab3b97a8e55 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1091 microversion: 2.1 time: 0.070979 May 26 17:07:14.675255 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 501/979] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:14 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1091 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:15.692673 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-91b79eb2-4685-4bf5-bb5a-21f8da17b6bf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:15.693365 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-91b79eb2-4685-4bf5-bb5a-21f8da17b6bf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:15.699971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91b79eb2-4685-4bf5-bb5a-21f8da17b6bf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:15.704762 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91b79eb2-4685-4bf5-bb5a-21f8da17b6bf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:15.704762 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91b79eb2-4685-4bf5-bb5a-21f8da17b6bf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:15.704762 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91b79eb2-4685-4bf5-bb5a-21f8da17b6bf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:15.763804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-91b79eb2-4685-4bf5-bb5a-21f8da17b6bf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:15.771288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-91b79eb2-4685-4bf5-bb5a-21f8da17b6bf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1141 microversion: 2.1 time: 0.083267 May 26 17:07:15.771861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 479/980] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:15 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1141 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:16.788298 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-61ed5560-38b3-4c1f-8632-77896630e404 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:16.788894 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-61ed5560-38b3-4c1f-8632-77896630e404 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:16.796198 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-61ed5560-38b3-4c1f-8632-77896630e404 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:16.796645 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-61ed5560-38b3-4c1f-8632-77896630e404 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:16.797409 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-61ed5560-38b3-4c1f-8632-77896630e404 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:16.797846 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-61ed5560-38b3-4c1f-8632-77896630e404 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:16.863635 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-61ed5560-38b3-4c1f-8632-77896630e404 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:16.871954 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-61ed5560-38b3-4c1f-8632-77896630e404 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1189 microversion: 2.1 time: 0.087713 May 26 17:07:16.872526 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 502/981] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:16 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1189 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:17.905090 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5f589fef-3bad-42b0-b514-7b19e4ebd844 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:17.905840 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5f589fef-3bad-42b0-b514-7b19e4ebd844 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:17.912343 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5f589fef-3bad-42b0-b514-7b19e4ebd844 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:17.912343 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5f589fef-3bad-42b0-b514-7b19e4ebd844 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:17.913431 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5f589fef-3bad-42b0-b514-7b19e4ebd844 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:17.913866 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5f589fef-3bad-42b0-b514-7b19e4ebd844 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:18.168251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-5f589fef-3bad-42b0-b514-7b19e4ebd844 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:18.177533 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5f589fef-3bad-42b0-b514-7b19e4ebd844 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1274 microversion: 2.1 time: 0.276322 May 26 17:07:18.187473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 480/982] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:17 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1274 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:19.195401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-79cd48a3-db64-4de4-9bc7-9bb7e3791056 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:19.196042 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-79cd48a3-db64-4de4-9bc7-9bb7e3791056 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:19.208247 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-79cd48a3-db64-4de4-9bc7-9bb7e3791056 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:19.209618 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-79cd48a3-db64-4de4-9bc7-9bb7e3791056 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:19.210016 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-79cd48a3-db64-4de4-9bc7-9bb7e3791056 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:19.210488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-79cd48a3-db64-4de4-9bc7-9bb7e3791056 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:19.215257 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-09ab18f7-b20d-4b10-a21e-049c7b76f68b req-643f4c58-e4a2-4003-9eb3-3538f3606357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e658131-bdbf-45c9-ade8-47d384a77f9a", "tag": "d0ed49f3-1a6a-48c4-be97-4787d5d53277"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:07:19.226251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-09ab18f7-b20d-4b10-a21e-049c7b76f68b req-643f4c58-e4a2-4003-9eb3-3538f3606357 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:19.228876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-09ab18f7-b20d-4b10-a21e-049c7b76f68b req-643f4c58-e4a2-4003-9eb3-3538f3606357 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:19.242525 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-09ab18f7-b20d-4b10-a21e-049c7b76f68b req-643f4c58-e4a2-4003-9eb3-3538f3606357 service nova] Creating event network-changed:d0ed49f3-1a6a-48c4-be97-4787d5d53277 for instance 5e658131-bdbf-45c9-ade8-47d384a77f9a on hv-cinder-83607 May 26 17:07:19.248042 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-09ab18f7-b20d-4b10-a21e-049c7b76f68b req-643f4c58-e4a2-4003-9eb3-3538f3606357 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042032 May 26 17:07:19.250628 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 481/983] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:07:19.374396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-79cd48a3-db64-4de4-9bc7-9bb7e3791056 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:19.382807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-79cd48a3-db64-4de4-9bc7-9bb7e3791056 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1274 microversion: 2.1 time: 0.191716 May 26 17:07:19.383396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 503/984] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:19 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:20.400977 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8033fb58-1acd-4649-b93e-886745f3e370 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:20.401665 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8033fb58-1acd-4649-b93e-886745f3e370 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:20.408316 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8033fb58-1acd-4649-b93e-886745f3e370 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:20.408759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8033fb58-1acd-4649-b93e-886745f3e370 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:20.409540 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8033fb58-1acd-4649-b93e-886745f3e370 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:20.409975 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8033fb58-1acd-4649-b93e-886745f3e370 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:20.543118 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8033fb58-1acd-4649-b93e-886745f3e370 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:20.550606 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8033fb58-1acd-4649-b93e-886745f3e370 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.154402 May 26 17:07:20.551177 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 482/985] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:20 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:21.566849 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-aedbde69-e0a7-414b-9bce-5be3300f4fbf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:21.567382 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-aedbde69-e0a7-414b-9bce-5be3300f4fbf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:21.574342 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aedbde69-e0a7-414b-9bce-5be3300f4fbf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:21.574794 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aedbde69-e0a7-414b-9bce-5be3300f4fbf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:21.575548 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aedbde69-e0a7-414b-9bce-5be3300f4fbf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:21.575977 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aedbde69-e0a7-414b-9bce-5be3300f4fbf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:21.713065 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-aedbde69-e0a7-414b-9bce-5be3300f4fbf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:21.720595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-aedbde69-e0a7-414b-9bce-5be3300f4fbf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.157690 May 26 17:07:21.721162 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 504/986] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:21 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:22.437589 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c1be3e50-6d33-4e5a-a7d9-73a30894833c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:22.438562 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c1be3e50-6d33-4e5a-a7d9-73a30894833c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:22.445557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c1be3e50-6d33-4e5a-a7d9-73a30894833c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:22.446009 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c1be3e50-6d33-4e5a-a7d9-73a30894833c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:22.446811 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c1be3e50-6d33-4e5a-a7d9-73a30894833c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:22.447251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c1be3e50-6d33-4e5a-a7d9-73a30894833c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:22.476746 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c1be3e50-6d33-4e5a-a7d9-73a30894833c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043009 May 26 17:07:22.477229 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 483/987] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:07:22 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 17:07:22.536899 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-93227704-8130-4303-81ba-ad36c08153d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:22.537390 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-93227704-8130-4303-81ba-ad36c08153d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:22.543716 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-93227704-8130-4303-81ba-ad36c08153d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:22.544173 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-93227704-8130-4303-81ba-ad36c08153d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:22.544928 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-93227704-8130-4303-81ba-ad36c08153d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:22.545358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-93227704-8130-4303-81ba-ad36c08153d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:22.570593 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-93227704-8130-4303-81ba-ad36c08153d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Going to try to terminate instance {{(pid=130526) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:07:22.737091 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-dfd5acd4-850a-464e-902e-ae45682a2951 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:22.737676 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-dfd5acd4-850a-464e-902e-ae45682a2951 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:22.744547 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dfd5acd4-850a-464e-902e-ae45682a2951 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:22.745004 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dfd5acd4-850a-464e-902e-ae45682a2951 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:22.745774 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dfd5acd4-850a-464e-902e-ae45682a2951 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:22.746214 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dfd5acd4-850a-464e-902e-ae45682a2951 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:22.882590 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-dfd5acd4-850a-464e-902e-ae45682a2951 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:22.890054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-dfd5acd4-850a-464e-902e-ae45682a2951 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.156998 May 26 17:07:22.890653 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 484/988] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:22 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:07:23.171523 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-93227704-8130-4303-81ba-ad36c08153d4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "DELETE /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 204 len: 0 microversion: 2.1 time: 0.637852 May 26 17:07:23.173033 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 505/989] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:07:22 2022] DELETE /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:07:23.178667 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:23.184233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=6 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:23.184233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-03295e48-d39f-44f7-bde1-e61f1e406265 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:23.184233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-03295e48-d39f-44f7-bde1-e61f1e406265 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:23.189924 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03295e48-d39f-44f7-bde1-e61f1e406265 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:23.190415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03295e48-d39f-44f7-bde1-e61f1e406265 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:23.191193 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03295e48-d39f-44f7-bde1-e61f1e406265 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:23.191630 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-03295e48-d39f-44f7-bde1-e61f1e406265 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:23.322023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-03295e48-d39f-44f7-bde1-e61f1e406265 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:23.329709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-03295e48-d39f-44f7-bde1-e61f1e406265 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1678 microversion: 2.1 time: 0.152447 May 26 17:07:23.330278 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 485/990] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:23 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:23.906668 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-98656e55-70bd-41c5-a4c1-79dd8750ee38 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:23.907380 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-98656e55-70bd-41c5-a4c1-79dd8750ee38 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:23.914003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-98656e55-70bd-41c5-a4c1-79dd8750ee38 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:23.914491 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-98656e55-70bd-41c5-a4c1-79dd8750ee38 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:23.915552 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-98656e55-70bd-41c5-a4c1-79dd8750ee38 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:23.915999 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-98656e55-70bd-41c5-a4c1-79dd8750ee38 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:24.047993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-98656e55-70bd-41c5-a4c1-79dd8750ee38 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:24.055587 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-98656e55-70bd-41c5-a4c1-79dd8750ee38 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.153291 May 26 17:07:24.056156 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 506/991] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:23 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:24.347241 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-50a977ce-ea65-4919-9d54-b0adc01dc975 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:24.347853 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-50a977ce-ea65-4919-9d54-b0adc01dc975 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:24.354998 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-50a977ce-ea65-4919-9d54-b0adc01dc975 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:24.362453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-50a977ce-ea65-4919-9d54-b0adc01dc975 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:24.362453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-50a977ce-ea65-4919-9d54-b0adc01dc975 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:24.362453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-50a977ce-ea65-4919-9d54-b0adc01dc975 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:24.489388 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-50a977ce-ea65-4919-9d54-b0adc01dc975 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:24.496906 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-50a977ce-ea65-4919-9d54-b0adc01dc975 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1678 microversion: 2.1 time: 0.153508 May 26 17:07:24.497470 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 486/992] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:24 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:25.072159 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-45c79541-1ce1-4f68-9a6f-1362223b9db2 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:25.072772 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-45c79541-1ce1-4f68-9a6f-1362223b9db2 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:25.074839 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:25.080327 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-45c79541-1ce1-4f68-9a6f-1362223b9db2 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:25.080768 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-45c79541-1ce1-4f68-9a6f-1362223b9db2 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:25.081518 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-45c79541-1ce1-4f68-9a6f-1362223b9db2 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:25.081948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-45c79541-1ce1-4f68-9a6f-1362223b9db2 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:25.219293 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-45c79541-1ce1-4f68-9a6f-1362223b9db2 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:25.226595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-45c79541-1ce1-4f68-9a6f-1362223b9db2 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.158296 May 26 17:07:25.227164 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 507/993] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:25 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:25.513894 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d64c5d68-bde6-48ff-a370-7429464cf546 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:25.514661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d64c5d68-bde6-48ff-a370-7429464cf546 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:25.521915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d64c5d68-bde6-48ff-a370-7429464cf546 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:25.522385 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d64c5d68-bde6-48ff-a370-7429464cf546 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:25.523169 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d64c5d68-bde6-48ff-a370-7429464cf546 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:25.523606 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d64c5d68-bde6-48ff-a370-7429464cf546 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:25.760253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d64c5d68-bde6-48ff-a370-7429464cf546 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:25.763474 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d64c5d68-bde6-48ff-a370-7429464cf546 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1678 microversion: 2.1 time: 0.253537 May 26 17:07:25.764065 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 487/994] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:25 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:26.243697 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-910fe21c-81a6-4cac-8b07-4e6acb51067d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:26.244392 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-910fe21c-81a6-4cac-8b07-4e6acb51067d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:26.250594 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-910fe21c-81a6-4cac-8b07-4e6acb51067d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:26.251109 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-910fe21c-81a6-4cac-8b07-4e6acb51067d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:26.251944 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-910fe21c-81a6-4cac-8b07-4e6acb51067d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:26.252439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-910fe21c-81a6-4cac-8b07-4e6acb51067d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:26.393162 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-910fe21c-81a6-4cac-8b07-4e6acb51067d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:26.401283 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-910fe21c-81a6-4cac-8b07-4e6acb51067d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.162266 May 26 17:07:26.402242 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 508/995] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:26 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:26.578928 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-19b1e500-73eb-4cab-aa17-63783b0e7657 req-7cc4cd62-abd8-475e-99ee-5340bf7cfc48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a551b1e0-dd51-440e-bf6f-b0600939ddeb", "name": "network-vif-deleted", "tag": "e779a056-07c4-4c1b-a39f-fd638345e925"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:07:26.588853 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-19b1e500-73eb-4cab-aa17-63783b0e7657 req-7cc4cd62-abd8-475e-99ee-5340bf7cfc48 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:26.589293 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-19b1e500-73eb-4cab-aa17-63783b0e7657 req-7cc4cd62-abd8-475e-99ee-5340bf7cfc48 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:26.603570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-19b1e500-73eb-4cab-aa17-63783b0e7657 req-7cc4cd62-abd8-475e-99ee-5340bf7cfc48 service nova] Creating event network-vif-deleted:e779a056-07c4-4c1b-a39f-fd638345e925 for instance a551b1e0-dd51-440e-bf6f-b0600939ddeb on hv-cinder-83607 May 26 17:07:26.609376 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-19b1e500-73eb-4cab-aa17-63783b0e7657 req-7cc4cd62-abd8-475e-99ee-5340bf7cfc48 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034945 May 26 17:07:26.609989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 488/996] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:07:26.781086 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-52795a89-9e4f-498c-8c36-aa2853d670c0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:26.782059 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-52795a89-9e4f-498c-8c36-aa2853d670c0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:26.789260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52795a89-9e4f-498c-8c36-aa2853d670c0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:26.789798 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52795a89-9e4f-498c-8c36-aa2853d670c0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:26.790703 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52795a89-9e4f-498c-8c36-aa2853d670c0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:26.791206 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-52795a89-9e4f-498c-8c36-aa2853d670c0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:26.855490 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-52795a89-9e4f-498c-8c36-aa2853d670c0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:26.863534 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-52795a89-9e4f-498c-8c36-aa2853d670c0 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1326 microversion: 2.1 time: 0.086403 May 26 17:07:26.864111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 509/997] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:26 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:27.418978 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7dc57c39-76df-43e8-b429-6fef84d8c4cf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:27.419679 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7dc57c39-76df-43e8-b429-6fef84d8c4cf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:27.427565 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7dc57c39-76df-43e8-b429-6fef84d8c4cf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:27.428159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7dc57c39-76df-43e8-b429-6fef84d8c4cf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:27.428939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7dc57c39-76df-43e8-b429-6fef84d8c4cf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:27.429379 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7dc57c39-76df-43e8-b429-6fef84d8c4cf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:27.572851 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7dc57c39-76df-43e8-b429-6fef84d8c4cf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:27.581338 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7dc57c39-76df-43e8-b429-6fef84d8c4cf tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.166589 May 26 17:07:27.582723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 489/998] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:27 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:27.882526 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ec6642c7-f97c-4c83-86e9-833342c05c76 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:27.883139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ec6642c7-f97c-4c83-86e9-833342c05c76 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:27.889734 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec6642c7-f97c-4c83-86e9-833342c05c76 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:27.890184 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec6642c7-f97c-4c83-86e9-833342c05c76 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:27.892813 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec6642c7-f97c-4c83-86e9-833342c05c76 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:27.892813 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec6642c7-f97c-4c83-86e9-833342c05c76 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:27.922428 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec6642c7-f97c-4c83-86e9-833342c05c76 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:27.922871 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec6642c7-f97c-4c83-86e9-833342c05c76 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:27.923320 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-ec6642c7-f97c-4c83-86e9-833342c05c76 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lazy-loading 'fault' on Instance uuid a551b1e0-dd51-440e-bf6f-b0600939ddeb {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:07:27.964981 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ec6642c7-f97c-4c83-86e9-833342c05c76 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:27.972375 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ec6642c7-f97c-4c83-86e9-833342c05c76 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1331 microversion: 2.1 time: 0.094419 May 26 17:07:27.972938 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 510/999] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:27 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:28.598517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d220ba16-f535-4657-b1e8-398d6b65a491 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:28.599057 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d220ba16-f535-4657-b1e8-398d6b65a491 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:28.606549 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d220ba16-f535-4657-b1e8-398d6b65a491 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:28.607000 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d220ba16-f535-4657-b1e8-398d6b65a491 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:28.607777 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d220ba16-f535-4657-b1e8-398d6b65a491 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:28.608212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d220ba16-f535-4657-b1e8-398d6b65a491 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:28.749670 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d220ba16-f535-4657-b1e8-398d6b65a491 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:28.757177 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d220ba16-f535-4657-b1e8-398d6b65a491 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.162612 May 26 17:07:28.757738 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 490/1000] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:28 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:28.991174 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0a08a779-d031-4ed0-832e-e5305edc4ee9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:28.992253 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0a08a779-d031-4ed0-832e-e5305edc4ee9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:29.001015 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0a08a779-d031-4ed0-832e-e5305edc4ee9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:29.001522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0a08a779-d031-4ed0-832e-e5305edc4ee9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:29.002392 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0a08a779-d031-4ed0-832e-e5305edc4ee9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:29.002846 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0a08a779-d031-4ed0-832e-e5305edc4ee9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:29.035711 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0a08a779-d031-4ed0-832e-e5305edc4ee9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:29.036130 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0a08a779-d031-4ed0-832e-e5305edc4ee9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:29.036582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-0a08a779-d031-4ed0-832e-e5305edc4ee9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lazy-loading 'fault' on Instance uuid a551b1e0-dd51-440e-bf6f-b0600939ddeb {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:07:29.078246 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0a08a779-d031-4ed0-832e-e5305edc4ee9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:29.087210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0a08a779-d031-4ed0-832e-e5305edc4ee9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 200 len: 1331 microversion: 2.1 time: 0.102019 May 26 17:07:29.087790 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 511/1001] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:28 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:29.773574 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-894e0389-b47c-4a6d-b5bb-1d1ffc2a38d0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:29.774184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-894e0389-b47c-4a6d-b5bb-1d1ffc2a38d0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:29.781035 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-894e0389-b47c-4a6d-b5bb-1d1ffc2a38d0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:29.781529 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-894e0389-b47c-4a6d-b5bb-1d1ffc2a38d0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:29.782305 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-894e0389-b47c-4a6d-b5bb-1d1ffc2a38d0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:29.782771 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-894e0389-b47c-4a6d-b5bb-1d1ffc2a38d0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:29.917816 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-894e0389-b47c-4a6d-b5bb-1d1ffc2a38d0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:29.925134 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-894e0389-b47c-4a6d-b5bb-1d1ffc2a38d0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.155896 May 26 17:07:29.925696 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 491/1002] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:29 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:30.104477 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ad0cbcbb-724a-46ab-98be-f3b1ea0706ac tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:30.105093 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ad0cbcbb-724a-46ab-98be-f3b1ea0706ac tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:30.111822 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ad0cbcbb-724a-46ab-98be-f3b1ea0706ac tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:30.112205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ad0cbcbb-724a-46ab-98be-f3b1ea0706ac tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:30.112978 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ad0cbcbb-724a-46ab-98be-f3b1ea0706ac tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:30.113413 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ad0cbcbb-724a-46ab-98be-f3b1ea0706ac tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:30.128159 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-ad0cbcbb-724a-46ab-98be-f3b1ea0706ac tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] HTTP exception thrown: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ad0cbcbb-724a-46ab-98be-f3b1ea0706ac tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Request method failure captured: May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb HTTP/1.1 May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GZviX4DkdfWz4xoNgrtRiWRKzw7RwHjmE1gO7uIlWyLS6FMbx1Wacl4so40DlpW4w-gblHOt9z4q0yId67L-PNhCAl3C-ocsC6fHXne_Woblkcmcleov13ASLOQoatRpsp1vZqDzW3Ar6kwUtXLnZEQvD2JSr9JHqtOGD9VR8OAgU May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 6f18b754d17d4ded958a80cf2781c72b May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeTestJSON-160059384 May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:07:30.129808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:07:30.131535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_6f18b754d17d4ded958a80cf2781c72b"}]}] May 26 17:07:30.131535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeTestJSON-160059384 May 26 17:07:30.131535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 6f18b754d17d4ded958a80cf2781c72b May 26 17:07:30.131535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeTestJSON-160059384 May 26 17:07:30.131535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeTestJSON-160059384-project May 26 17:07:30.131535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:07:30.131535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:07:30.131535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 8207acca876a4af5ac75dd4283916763 May 26 17:07:30.131535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeTestJSON-160059384-project May 26 17:07:30.131535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:07:30.131535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:07:30.131535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'a551b1e0-dd51-440e-bf6f-b0600939ddeb'} May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:07:30.132314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:07:30.133574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:07:30.134832 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ad0cbcbb-724a-46ab-98be-f3b1ea0706ac tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Returning 404 to user: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:07:30.134832 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ad0cbcbb-724a-46ab-98be-f3b1ea0706ac tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 404 len: 111 microversion: 2.1 time: 0.030777 May 26 17:07:30.134832 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 512/1003] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:30 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:07:30.140318 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-968dbf5b-5c38-42a2-b6e4-ca9c3739aec4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '.version_select at 0x7fd2512b2af0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:30.219315 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-968dbf5b-5c38-42a2-b6e4-ca9c3739aec4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-758420915" status: 202 len: 0 microversion: 2.1 time: 0.082636 May 26 17:07:30.223720 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 492/1004] 10.222.0.112 () {58 vars in 1222 bytes} [Thu May 26 17:07:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-758420915 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:07:30.941610 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7a6c7e7e-a330-4eed-aa98-b96a7a9861dc tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:30.942564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7a6c7e7e-a330-4eed-aa98-b96a7a9861dc tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:30.949097 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a6c7e7e-a330-4eed-aa98-b96a7a9861dc tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:30.949865 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a6c7e7e-a330-4eed-aa98-b96a7a9861dc tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:30.950653 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a6c7e7e-a330-4eed-aa98-b96a7a9861dc tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:30.951084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a6c7e7e-a330-4eed-aa98-b96a7a9861dc tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:31.032137 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ccfd7b03-d797-4ccd-8a6c-1dfe40a98a36 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Action: 'create', calling method: .version_select at 0x7fd251363d30>, body: {"keypair": {"name": "tempest-keypair-1911840862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx6akYQfcR0cHrzv7x6671Ss3EIqB4TG6S5thjEJWujPNSlJ4d36AuAvnVWLXgWSBE1rH+4X4zSCg2kpQsezFoOlW9sjxHBUcxaSp5hMDNEuIVh5lT6iIxBsp088POtyw=="}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:07:31.051912 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-ccfd7b03-d797-4ccd-8a6c-1dfe40a98a36 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Getting quotas for project 6f18b754d17d4ded958a80cf2781c72b. Resources: {'key_pairs'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:07:31.060452 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-ccfd7b03-d797-4ccd-8a6c-1dfe40a98a36 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Getting quotas for user 8207acca876a4af5ac75dd4283916763 and project 6f18b754d17d4ded958a80cf2781c72b. Resources: {'key_pairs'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:07:31.110700 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7a6c7e7e-a330-4eed-aa98-b96a7a9861dc tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:31.119070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7a6c7e7e-a330-4eed-aa98-b96a7a9861dc tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.181370 May 26 17:07:31.119646 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 513/1005] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:30 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:31.167825 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ccfd7b03-d797-4ccd-8a6c-1dfe40a98a36 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139442 May 26 17:07:31.168376 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 493/1006] 10.222.0.112 () {60 vars in 1163 bytes} [Thu May 26 17:07:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:07:32.136434 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4af303ef-7b0d-48f5-a306-dadf5b13ab5c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:32.137053 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4af303ef-7b0d-48f5-a306-dadf5b13ab5c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:32.143814 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4af303ef-7b0d-48f5-a306-dadf5b13ab5c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:32.144272 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4af303ef-7b0d-48f5-a306-dadf5b13ab5c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:32.145080 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4af303ef-7b0d-48f5-a306-dadf5b13ab5c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:32.145527 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4af303ef-7b0d-48f5-a306-dadf5b13ab5c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:32.309683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4af303ef-7b0d-48f5-a306-dadf5b13ab5c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:32.317466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4af303ef-7b0d-48f5-a306-dadf5b13ab5c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.184970 May 26 17:07:32.318241 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 514/1007] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:32 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:07:32.704314 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-4dc3c7ea-4f43-4300-ba9b-0094016577bb req-7e76df6c-0e38-48fc-a211-7ce11e620000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e658131-bdbf-45c9-ade8-47d384a77f9a", "name": "network-vif-plugged", "status": "completed", "tag": "d0ed49f3-1a6a-48c4-be97-4787d5d53277"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:07:32.715762 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-4dc3c7ea-4f43-4300-ba9b-0094016577bb req-7e76df6c-0e38-48fc-a211-7ce11e620000 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:32.715762 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-4dc3c7ea-4f43-4300-ba9b-0094016577bb req-7e76df6c-0e38-48fc-a211-7ce11e620000 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:32.727356 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-4dc3c7ea-4f43-4300-ba9b-0094016577bb req-7e76df6c-0e38-48fc-a211-7ce11e620000 service nova] Creating event network-vif-plugged:d0ed49f3-1a6a-48c4-be97-4787d5d53277 for instance 5e658131-bdbf-45c9-ade8-47d384a77f9a on hv-cinder-83607 May 26 17:07:32.732531 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-4dc3c7ea-4f43-4300-ba9b-0094016577bb req-7e76df6c-0e38-48fc-a211-7ce11e620000 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033655 May 26 17:07:32.733312 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 494/1008] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:07:33.334809 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ba06d1c4-5893-4a37-966e-4924869a89e6 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:33.335417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ba06d1c4-5893-4a37-966e-4924869a89e6 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:33.341727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba06d1c4-5893-4a37-966e-4924869a89e6 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:33.342167 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba06d1c4-5893-4a37-966e-4924869a89e6 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:33.342947 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba06d1c4-5893-4a37-966e-4924869a89e6 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:33.343379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba06d1c4-5893-4a37-966e-4924869a89e6 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:33.552701 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ba06d1c4-5893-4a37-966e-4924869a89e6 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:33.560390 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ba06d1c4-5893-4a37-966e-4924869a89e6 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.230200 May 26 17:07:33.560962 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 515/1009] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:33 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:33.769362 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1053396098", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e270676-3704-4c21-93c0-8b36f5ceb9d6"}], "security_groups": [{"name": "tempest-securitygroup--1824151097"}], "key_name": "tempest-keypair-1911840862", "user_data": "}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:07:33.876777 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] validate_networks() for [('3e270676-3704-4c21-93c0-8b36f5ceb9d6', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:07:34.258052 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:07:34.258525 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:07:34.258999 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:07:34.259412 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:07:34.259827 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:07:34.268821 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:34.272904 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:34.272904 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:34.272904 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:34.287127 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Getting quotas for project 6f18b754d17d4ded958a80cf2781c72b. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:07:34.291107 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Getting quotas for user 8207acca876a4af5ac75dd4283916763 and project 6f18b754d17d4ded958a80cf2781c72b. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:07:34.302846 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:07:34.305240 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:07:34.477323 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cc327d06-31ca-4635-ae5b-701d963d292d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.713114 May 26 17:07:34.477878 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 495/1010] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:07:33 2022] POST /compute/v2.1/servers => generated 404 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:07:34.488619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8bc00936-c334-4bdc-8ccc-d86ee3ccbc5d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:34.489234 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8bc00936-c334-4bdc-8ccc-d86ee3ccbc5d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:34.558869 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8bc00936-c334-4bdc-8ccc-d86ee3ccbc5d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:34.568844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8bc00936-c334-4bdc-8ccc-d86ee3ccbc5d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1242 microversion: 2.1 time: 0.083411 May 26 17:07:34.569678 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 516/1011] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:34 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:07:34.581072 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-65bd9410-2b12-40e6-b9ed-c0e4455b7d9f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:34.582123 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-65bd9410-2b12-40e6-b9ed-c0e4455b7d9f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:34.593049 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-65bd9410-2b12-40e6-b9ed-c0e4455b7d9f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:34.593625 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-65bd9410-2b12-40e6-b9ed-c0e4455b7d9f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:34.594623 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-65bd9410-2b12-40e6-b9ed-c0e4455b7d9f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:34.595214 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-65bd9410-2b12-40e6-b9ed-c0e4455b7d9f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:34.740444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-65bd9410-2b12-40e6-b9ed-c0e4455b7d9f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:34.748062 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-65bd9410-2b12-40e6-b9ed-c0e4455b7d9f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.174717 May 26 17:07:34.748619 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 496/1012] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:34 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:07:35.586973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-88fdd484-f667-41d1-9740-f5854ff9bdb1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:35.587596 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-88fdd484-f667-41d1-9740-f5854ff9bdb1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:35.595055 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-88fdd484-f667-41d1-9740-f5854ff9bdb1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:35.595504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-88fdd484-f667-41d1-9740-f5854ff9bdb1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:35.596279 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-88fdd484-f667-41d1-9740-f5854ff9bdb1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:35.596714 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-88fdd484-f667-41d1-9740-f5854ff9bdb1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:35.663233 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-88fdd484-f667-41d1-9740-f5854ff9bdb1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:35.666743 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:35.671005 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-88fdd484-f667-41d1-9740-f5854ff9bdb1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1246 microversion: 2.1 time: 0.088624 May 26 17:07:35.671744 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 517/1013] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:35 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:35.765467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-bca6f9d6-8d9c-4a39-8218-6a417c6671f0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:35.766015 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-bca6f9d6-8d9c-4a39-8218-6a417c6671f0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:35.773300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bca6f9d6-8d9c-4a39-8218-6a417c6671f0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:35.773765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bca6f9d6-8d9c-4a39-8218-6a417c6671f0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:35.774570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bca6f9d6-8d9c-4a39-8218-6a417c6671f0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:35.775009 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bca6f9d6-8d9c-4a39-8218-6a417c6671f0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:35.908997 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bca6f9d6-8d9c-4a39-8218-6a417c6671f0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:35.916791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-bca6f9d6-8d9c-4a39-8218-6a417c6671f0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1262 microversion: 2.1 time: 0.155237 May 26 17:07:35.917363 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 497/1014] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:35 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1262 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:36.688319 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-45794688-f0e3-412e-ab65-949fae434d46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:36.688937 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-45794688-f0e3-412e-ab65-949fae434d46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:36.696341 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-45794688-f0e3-412e-ab65-949fae434d46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:36.696806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-45794688-f0e3-412e-ab65-949fae434d46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:36.697636 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-45794688-f0e3-412e-ab65-949fae434d46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:36.698072 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-45794688-f0e3-412e-ab65-949fae434d46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:36.760627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-45794688-f0e3-412e-ab65-949fae434d46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:36.768211 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-45794688-f0e3-412e-ab65-949fae434d46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1238 microversion: 2.1 time: 0.083789 May 26 17:07:36.768781 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 518/1015] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:36 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:36.934856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-371bb43d-3d6c-43d4-a366-a11f1258d38f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:36.935434 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-371bb43d-3d6c-43d4-a366-a11f1258d38f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:36.941759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-371bb43d-3d6c-43d4-a366-a11f1258d38f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:36.942201 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-371bb43d-3d6c-43d4-a366-a11f1258d38f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:36.943007 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-371bb43d-3d6c-43d4-a366-a11f1258d38f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:36.943430 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-371bb43d-3d6c-43d4-a366-a11f1258d38f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:37.084174 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-371bb43d-3d6c-43d4-a366-a11f1258d38f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:37.091746 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-371bb43d-3d6c-43d4-a366-a11f1258d38f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1446 microversion: 2.1 time: 0.160915 May 26 17:07:37.092312 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 498/1016] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:36 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1446 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:07:37.113528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4fac0b0e-74c6-4b48-a6c2-28d9a3e7ae69 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:37.114146 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4fac0b0e-74c6-4b48-a6c2-28d9a3e7ae69 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:37.120660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4fac0b0e-74c6-4b48-a6c2-28d9a3e7ae69 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:37.121132 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4fac0b0e-74c6-4b48-a6c2-28d9a3e7ae69 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:37.121894 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4fac0b0e-74c6-4b48-a6c2-28d9a3e7ae69 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:37.122350 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4fac0b0e-74c6-4b48-a6c2-28d9a3e7ae69 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:37.252843 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4fac0b0e-74c6-4b48-a6c2-28d9a3e7ae69 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:37.260979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4fac0b0e-74c6-4b48-a6c2-28d9a3e7ae69 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1446 microversion: 2.1 time: 0.151366 May 26 17:07:37.261546 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 519/1017] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:37 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:37.785550 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a41e12a6-6ea9-4802-a4b7-40ade8ff58ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:37.788257 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a41e12a6-6ea9-4802-a4b7-40ade8ff58ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:37.794854 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a41e12a6-6ea9-4802-a4b7-40ade8ff58ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:37.795575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a41e12a6-6ea9-4802-a4b7-40ade8ff58ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:37.796544 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a41e12a6-6ea9-4802-a4b7-40ade8ff58ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:37.797178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a41e12a6-6ea9-4802-a4b7-40ade8ff58ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:37.873460 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a41e12a6-6ea9-4802-a4b7-40ade8ff58ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:37.878176 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:37.883645 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a41e12a6-6ea9-4802-a4b7-40ade8ff58ef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1294 microversion: 2.1 time: 0.101990 May 26 17:07:37.884412 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 499/1018] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:37 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:38.298480 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5c267e92-0719-4ef1-8dee-6c2333aa0ad3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:38.299727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5c267e92-0719-4ef1-8dee-6c2333aa0ad3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:38.307896 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c267e92-0719-4ef1-8dee-6c2333aa0ad3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:38.308675 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c267e92-0719-4ef1-8dee-6c2333aa0ad3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:38.309650 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c267e92-0719-4ef1-8dee-6c2333aa0ad3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:38.310370 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c267e92-0719-4ef1-8dee-6c2333aa0ad3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:38.405006 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-5c267e92-0719-4ef1-8dee-6c2333aa0ad3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lazy-loading 'services' on Instance uuid ea078281-ddf9-4637-9cfd-ca0709e2e74d {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:07:38.680810 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5c267e92-0719-4ef1-8dee-6c2333aa0ad3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "DELETE /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments/a25459d1-2b07-4418-be96-1aaecf81518d" status: 202 len: 0 microversion: 2.1 time: 0.386476 May 26 17:07:38.681760 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 520/1019] 10.222.0.112 () {58 vars in 1420 bytes} [Thu May 26 17:07:38 2022] DELETE /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments/a25459d1-2b07-4418-be96-1aaecf81518d => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:07:38.691481 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1286fc62-c6ca-4ec4-aaef-115bef859a20 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:38.692368 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1286fc62-c6ca-4ec4-aaef-115bef859a20 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:38.700754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1286fc62-c6ca-4ec4-aaef-115bef859a20 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:38.701104 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1286fc62-c6ca-4ec4-aaef-115bef859a20 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:38.702040 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1286fc62-c6ca-4ec4-aaef-115bef859a20 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:38.703141 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1286fc62-c6ca-4ec4-aaef-115bef859a20 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:38.737080 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1286fc62-c6ca-4ec4-aaef-115bef859a20 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050923 May 26 17:07:38.737666 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 500/1020] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:07:38 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:07:38.901959 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b288b756-0611-4a1b-ada8-6da1c859a2cc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:38.902697 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b288b756-0611-4a1b-ada8-6da1c859a2cc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:38.909350 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b288b756-0611-4a1b-ada8-6da1c859a2cc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:38.910028 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b288b756-0611-4a1b-ada8-6da1c859a2cc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:38.916337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b288b756-0611-4a1b-ada8-6da1c859a2cc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:38.916337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b288b756-0611-4a1b-ada8-6da1c859a2cc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:39.009662 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b288b756-0611-4a1b-ada8-6da1c859a2cc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:39.017592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b288b756-0611-4a1b-ada8-6da1c859a2cc tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1300 microversion: 2.1 time: 0.119942 May 26 17:07:39.018165 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 521/1021] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:38 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:39.424077 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-bbf1ef03-8cd7-46d9-b884-6a003be8f647 req-e20948ec-5c36-43e2-ae19-0fe328b6f31d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e658131-bdbf-45c9-ade8-47d384a77f9a", "tag": "d0ed49f3-1a6a-48c4-be97-4787d5d53277"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:07:39.446297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-bbf1ef03-8cd7-46d9-b884-6a003be8f647 req-e20948ec-5c36-43e2-ae19-0fe328b6f31d service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:39.446297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-bbf1ef03-8cd7-46d9-b884-6a003be8f647 req-e20948ec-5c36-43e2-ae19-0fe328b6f31d service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:39.452486 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-bbf1ef03-8cd7-46d9-b884-6a003be8f647 req-e20948ec-5c36-43e2-ae19-0fe328b6f31d service nova] Creating event network-changed:d0ed49f3-1a6a-48c4-be97-4787d5d53277 for instance 5e658131-bdbf-45c9-ade8-47d384a77f9a on hv-cinder-83607 May 26 17:07:39.458504 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-bbf1ef03-8cd7-46d9-b884-6a003be8f647 req-e20948ec-5c36-43e2-ae19-0fe328b6f31d service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038429 May 26 17:07:39.459414 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 501/1022] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:07:39.749337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1402b966-0ec6-4f67-bd45-3e8628bf2eba tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:39.750426 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1402b966-0ec6-4f67-bd45-3e8628bf2eba tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:39.757517 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1402b966-0ec6-4f67-bd45-3e8628bf2eba tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:39.757968 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1402b966-0ec6-4f67-bd45-3e8628bf2eba tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:39.758761 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1402b966-0ec6-4f67-bd45-3e8628bf2eba tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:39.759311 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1402b966-0ec6-4f67-bd45-3e8628bf2eba tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:39.789956 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1402b966-0ec6-4f67-bd45-3e8628bf2eba tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044636 May 26 17:07:39.790784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 522/1023] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:07:39 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:07:40.041686 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-09cd4042-e3b8-4b01-918b-9cba3554602e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:40.042651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-09cd4042-e3b8-4b01-918b-9cba3554602e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:40.048918 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-09cd4042-e3b8-4b01-918b-9cba3554602e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:40.049362 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-09cd4042-e3b8-4b01-918b-9cba3554602e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:40.050121 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-09cd4042-e3b8-4b01-918b-9cba3554602e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:40.050576 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-09cd4042-e3b8-4b01-918b-9cba3554602e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:40.274520 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-09cd4042-e3b8-4b01-918b-9cba3554602e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:40.282507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-09cd4042-e3b8-4b01-918b-9cba3554602e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.245778 May 26 17:07:40.283347 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 502/1024] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:40 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:40.801195 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d322a960-f98c-4c7e-8644-f343f6dec353 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:40.802699 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d322a960-f98c-4c7e-8644-f343f6dec353 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:40.809145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d322a960-f98c-4c7e-8644-f343f6dec353 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:40.809599 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d322a960-f98c-4c7e-8644-f343f6dec353 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:40.810402 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d322a960-f98c-4c7e-8644-f343f6dec353 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:40.810842 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d322a960-f98c-4c7e-8644-f343f6dec353 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:40.842678 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d322a960-f98c-4c7e-8644-f343f6dec353 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045410 May 26 17:07:40.843254 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 523/1025] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:07:40 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:07:41.300622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1419aa79-2408-45cd-a1b1-333eadeedf46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:41.301246 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1419aa79-2408-45cd-a1b1-333eadeedf46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:41.308513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1419aa79-2408-45cd-a1b1-333eadeedf46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:41.308974 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1419aa79-2408-45cd-a1b1-333eadeedf46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:41.309776 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1419aa79-2408-45cd-a1b1-333eadeedf46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:41.310216 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1419aa79-2408-45cd-a1b1-333eadeedf46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:41.420027 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-09a2ceaa-67a4-4275-a920-d2ce88196da5 req-6061e742-6ecd-418f-8506-e59560a42257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d85e129-1f91-4dd5-a330-867543373c26", "tag": "5cf74066-ff82-453f-8a5c-8af488ca071d"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:07:41.430590 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-09a2ceaa-67a4-4275-a920-d2ce88196da5 req-6061e742-6ecd-418f-8506-e59560a42257 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:41.431033 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-09a2ceaa-67a4-4275-a920-d2ce88196da5 req-6061e742-6ecd-418f-8506-e59560a42257 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:41.447629 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-09a2ceaa-67a4-4275-a920-d2ce88196da5 req-6061e742-6ecd-418f-8506-e59560a42257 service nova] Creating event network-changed:5cf74066-ff82-453f-8a5c-8af488ca071d for instance 1d85e129-1f91-4dd5-a330-867543373c26 on hv-cinder-83607 May 26 17:07:41.451870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-09a2ceaa-67a4-4275-a920-d2ce88196da5 req-6061e742-6ecd-418f-8506-e59560a42257 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035552 May 26 17:07:41.453041 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 524/1026] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:07:41.499005 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1419aa79-2408-45cd-a1b1-333eadeedf46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:41.508619 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1419aa79-2408-45cd-a1b1-333eadeedf46 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.211351 May 26 17:07:41.518401 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 503/1027] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:41 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:41.855578 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3bd6e705-3788-4a1e-b1a3-2b2d8e5e634d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:41.856582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3bd6e705-3788-4a1e-b1a3-2b2d8e5e634d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:41.863232 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3bd6e705-3788-4a1e-b1a3-2b2d8e5e634d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:41.869216 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3bd6e705-3788-4a1e-b1a3-2b2d8e5e634d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:41.869216 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3bd6e705-3788-4a1e-b1a3-2b2d8e5e634d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:41.869216 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3bd6e705-3788-4a1e-b1a3-2b2d8e5e634d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:41.898916 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3bd6e705-3788-4a1e-b1a3-2b2d8e5e634d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047628 May 26 17:07:41.906007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 525/1028] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:07:41 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:07:41.984419 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a7f21831-ff70-4db4-8695-2722b4da5a3d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:41.984915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a7f21831-ff70-4db4-8695-2722b4da5a3d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:41.991397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a7f21831-ff70-4db4-8695-2722b4da5a3d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:41.991856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a7f21831-ff70-4db4-8695-2722b4da5a3d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:41.992626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a7f21831-ff70-4db4-8695-2722b4da5a3d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:41.993062 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a7f21831-ff70-4db4-8695-2722b4da5a3d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:42.018557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a7f21831-ff70-4db4-8695-2722b4da5a3d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Going to try to terminate instance {{(pid=130525) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:07:42.201571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:42.321018 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a7f21831-ff70-4db4-8695-2722b4da5a3d tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "DELETE /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 204 len: 0 microversion: 2.1 time: 0.340062 May 26 17:07:42.321760 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 504/1029] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:07:41 2022] DELETE /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:07:42.330146 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c40a128b-9c50-4aa7-b556-8bad7dd48abf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:42.330803 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c40a128b-9c50-4aa7-b556-8bad7dd48abf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:42.337613 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c40a128b-9c50-4aa7-b556-8bad7dd48abf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:42.338064 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c40a128b-9c50-4aa7-b556-8bad7dd48abf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:42.338875 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c40a128b-9c50-4aa7-b556-8bad7dd48abf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:42.339314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c40a128b-9c50-4aa7-b556-8bad7dd48abf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:42.469082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c40a128b-9c50-4aa7-b556-8bad7dd48abf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:42.477537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c40a128b-9c50-4aa7-b556-8bad7dd48abf tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1694 microversion: 2.1 time: 0.151706 May 26 17:07:42.478058 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 526/1030] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:42 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:42.526362 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8b54df1e-7624-4c55-8b0c-5b17967ddf5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:42.527090 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8b54df1e-7624-4c55-8b0c-5b17967ddf5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:42.533721 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8b54df1e-7624-4c55-8b0c-5b17967ddf5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:42.534163 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8b54df1e-7624-4c55-8b0c-5b17967ddf5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:42.535024 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8b54df1e-7624-4c55-8b0c-5b17967ddf5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:42.535452 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8b54df1e-7624-4c55-8b0c-5b17967ddf5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:42.666934 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8b54df1e-7624-4c55-8b0c-5b17967ddf5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:42.674289 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8b54df1e-7624-4c55-8b0c-5b17967ddf5a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.152948 May 26 17:07:42.674887 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 505/1031] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:42 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:43.494710 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e50972a3-7330-449c-9509-9b258ed85bc5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:43.495233 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e50972a3-7330-449c-9509-9b258ed85bc5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:43.501606 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e50972a3-7330-449c-9509-9b258ed85bc5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:43.502060 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e50972a3-7330-449c-9509-9b258ed85bc5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:43.502850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e50972a3-7330-449c-9509-9b258ed85bc5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:43.503289 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e50972a3-7330-449c-9509-9b258ed85bc5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:43.631545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e50972a3-7330-449c-9509-9b258ed85bc5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:43.638910 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e50972a3-7330-449c-9509-9b258ed85bc5 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1694 microversion: 2.1 time: 0.148264 May 26 17:07:43.639470 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 527/1032] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:43 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1694 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:43.693279 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7126b0ec-f942-40a1-aaf3-863ac3626919 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:43.693892 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7126b0ec-f942-40a1-aaf3-863ac3626919 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:43.700357 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7126b0ec-f942-40a1-aaf3-863ac3626919 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:43.700810 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7126b0ec-f942-40a1-aaf3-863ac3626919 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:43.701754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7126b0ec-f942-40a1-aaf3-863ac3626919 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:43.702193 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7126b0ec-f942-40a1-aaf3-863ac3626919 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:43.836252 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7126b0ec-f942-40a1-aaf3-863ac3626919 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:43.843662 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7126b0ec-f942-40a1-aaf3-863ac3626919 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.154705 May 26 17:07:43.844228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 506/1033] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:43 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:44.656728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-66485bcc-f504-426e-867c-fe22ee10c5a0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:44.657362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-66485bcc-f504-426e-867c-fe22ee10c5a0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:44.659762 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:44.660418 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:44.666133 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-66485bcc-f504-426e-867c-fe22ee10c5a0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:44.670263 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-66485bcc-f504-426e-867c-fe22ee10c5a0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:44.670263 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-66485bcc-f504-426e-867c-fe22ee10c5a0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:44.670263 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-66485bcc-f504-426e-867c-fe22ee10c5a0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:44.799597 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-66485bcc-f504-426e-867c-fe22ee10c5a0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:44.807523 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-66485bcc-f504-426e-867c-fe22ee10c5a0 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1694 microversion: 2.1 time: 0.154705 May 26 17:07:44.808086 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 528/1034] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:44 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:44.860951 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-56d49bd7-3af1-4ec2-93c3-6fc3e0c32131 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:44.861572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-56d49bd7-3af1-4ec2-93c3-6fc3e0c32131 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:44.863411 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:44.864211 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=10 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:44.870810 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-56d49bd7-3af1-4ec2-93c3-6fc3e0c32131 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:44.871270 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-56d49bd7-3af1-4ec2-93c3-6fc3e0c32131 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:44.872078 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-56d49bd7-3af1-4ec2-93c3-6fc3e0c32131 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:44.872521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-56d49bd7-3af1-4ec2-93c3-6fc3e0c32131 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:45.001130 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-56d49bd7-3af1-4ec2-93c3-6fc3e0c32131 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:45.009634 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-56d49bd7-3af1-4ec2-93c3-6fc3e0c32131 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.152585 May 26 17:07:45.010201 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 507/1035] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:44 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:45.824129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0c45b7b4-76a4-4e2b-bf92-57c4a90e14a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:45.824739 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0c45b7b4-76a4-4e2b-bf92-57c4a90e14a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:45.831652 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0c45b7b4-76a4-4e2b-bf92-57c4a90e14a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:45.832030 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0c45b7b4-76a4-4e2b-bf92-57c4a90e14a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:45.832788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0c45b7b4-76a4-4e2b-bf92-57c4a90e14a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:45.833228 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0c45b7b4-76a4-4e2b-bf92-57c4a90e14a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:45.963145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0c45b7b4-76a4-4e2b-bf92-57c4a90e14a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:45.970763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0c45b7b4-76a4-4e2b-bf92-57c4a90e14a1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1694 microversion: 2.1 time: 0.150434 May 26 17:07:45.971323 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 529/1036] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:45 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:46.026049 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8fb21bae-2ed6-49c3-ba3c-cfb4f581d1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:46.026691 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8fb21bae-2ed6-49c3-ba3c-cfb4f581d1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:46.033146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8fb21bae-2ed6-49c3-ba3c-cfb4f581d1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:46.033592 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8fb21bae-2ed6-49c3-ba3c-cfb4f581d1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:46.034376 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8fb21bae-2ed6-49c3-ba3c-cfb4f581d1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:46.034811 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8fb21bae-2ed6-49c3-ba3c-cfb4f581d1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:46.165574 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8fb21bae-2ed6-49c3-ba3c-cfb4f581d1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:46.172849 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8fb21bae-2ed6-49c3-ba3c-cfb4f581d1f4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.150678 May 26 17:07:46.173423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 508/1037] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:46 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:46.988177 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-734324c5-7147-4a99-a5d8-7c266931c150 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:46.988771 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-734324c5-7147-4a99-a5d8-7c266931c150 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:46.995374 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-734324c5-7147-4a99-a5d8-7c266931c150 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:46.995830 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-734324c5-7147-4a99-a5d8-7c266931c150 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:46.996825 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-734324c5-7147-4a99-a5d8-7c266931c150 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:46.997022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-734324c5-7147-4a99-a5d8-7c266931c150 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:47.133902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-734324c5-7147-4a99-a5d8-7c266931c150 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:47.141403 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-734324c5-7147-4a99-a5d8-7c266931c150 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1694 microversion: 2.1 time: 0.157129 May 26 17:07:47.141970 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 530/1038] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:46 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:47.193112 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2a5baac3-07db-44d8-803e-6434b3695c7b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:47.193765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-2a5baac3-07db-44d8-803e-6434b3695c7b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:47.200174 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2a5baac3-07db-44d8-803e-6434b3695c7b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:47.201036 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2a5baac3-07db-44d8-803e-6434b3695c7b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:47.201387 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2a5baac3-07db-44d8-803e-6434b3695c7b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:47.201821 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2a5baac3-07db-44d8-803e-6434b3695c7b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:47.334034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2a5baac3-07db-44d8-803e-6434b3695c7b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:47.342203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-2a5baac3-07db-44d8-803e-6434b3695c7b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.153404 May 26 17:07:47.342802 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 509/1039] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:47 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:48.159324 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c3494a47-8256-465a-a4ce-53f9f78f9f24 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:48.159957 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c3494a47-8256-465a-a4ce-53f9f78f9f24 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:48.166976 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c3494a47-8256-465a-a4ce-53f9f78f9f24 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:48.167414 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c3494a47-8256-465a-a4ce-53f9f78f9f24 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:48.168162 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c3494a47-8256-465a-a4ce-53f9f78f9f24 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:48.168586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c3494a47-8256-465a-a4ce-53f9f78f9f24 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:48.296267 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c3494a47-8256-465a-a4ce-53f9f78f9f24 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:48.304202 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c3494a47-8256-465a-a4ce-53f9f78f9f24 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1694 microversion: 2.1 time: 0.148663 May 26 17:07:48.304784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 531/1040] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:48 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1694 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:48.360360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-76b47bf0-4b18-46b1-90f0-5a63aa892b2b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:48.360964 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-76b47bf0-4b18-46b1-90f0-5a63aa892b2b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:48.367956 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-76b47bf0-4b18-46b1-90f0-5a63aa892b2b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:48.368397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-76b47bf0-4b18-46b1-90f0-5a63aa892b2b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:48.369191 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-76b47bf0-4b18-46b1-90f0-5a63aa892b2b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:48.369620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-76b47bf0-4b18-46b1-90f0-5a63aa892b2b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:48.502040 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-76b47bf0-4b18-46b1-90f0-5a63aa892b2b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:48.510306 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-76b47bf0-4b18-46b1-90f0-5a63aa892b2b tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.154160 May 26 17:07:48.510916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 510/1041] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:48 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:49.321652 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b6b9b5b8-2055-4661-a4de-4a22eac56233 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:49.322260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b6b9b5b8-2055-4661-a4de-4a22eac56233 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:49.329136 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b6b9b5b8-2055-4661-a4de-4a22eac56233 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:49.329600 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b6b9b5b8-2055-4661-a4de-4a22eac56233 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:49.330395 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b6b9b5b8-2055-4661-a4de-4a22eac56233 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:49.330861 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b6b9b5b8-2055-4661-a4de-4a22eac56233 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:49.460096 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b6b9b5b8-2055-4661-a4de-4a22eac56233 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:49.467848 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b6b9b5b8-2055-4661-a4de-4a22eac56233 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1694 microversion: 2.1 time: 0.150720 May 26 17:07:49.468418 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 532/1042] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:49 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:49.527561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6c39043f-3ac6-45b3-be22-a3f5fbbfccef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:49.528355 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6c39043f-3ac6-45b3-be22-a3f5fbbfccef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:49.535789 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6c39043f-3ac6-45b3-be22-a3f5fbbfccef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:49.537093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6c39043f-3ac6-45b3-be22-a3f5fbbfccef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:49.538014 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6c39043f-3ac6-45b3-be22-a3f5fbbfccef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:49.538562 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6c39043f-3ac6-45b3-be22-a3f5fbbfccef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:49.671940 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6c39043f-3ac6-45b3-be22-a3f5fbbfccef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:49.680513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6c39043f-3ac6-45b3-be22-a3f5fbbfccef tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.156849 May 26 17:07:49.681093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 511/1043] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:49 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:50.485585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2d0ef82b-238a-4888-b7d7-5738b812d467 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:50.486110 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2d0ef82b-238a-4888-b7d7-5738b812d467 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:50.493724 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2d0ef82b-238a-4888-b7d7-5738b812d467 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:50.494190 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2d0ef82b-238a-4888-b7d7-5738b812d467 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:50.494985 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2d0ef82b-238a-4888-b7d7-5738b812d467 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:50.495414 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2d0ef82b-238a-4888-b7d7-5738b812d467 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:50.628392 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2d0ef82b-238a-4888-b7d7-5738b812d467 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:50.636851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2d0ef82b-238a-4888-b7d7-5738b812d467 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1694 microversion: 2.1 time: 0.155116 May 26 17:07:50.637438 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 533/1044] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:50 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:50.698467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0e9b543c-0ead-4c98-ac77-bddbd7c4b03e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:50.699086 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0e9b543c-0ead-4c98-ac77-bddbd7c4b03e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:50.706213 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0e9b543c-0ead-4c98-ac77-bddbd7c4b03e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:50.706717 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0e9b543c-0ead-4c98-ac77-bddbd7c4b03e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:50.707499 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0e9b543c-0ead-4c98-ac77-bddbd7c4b03e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:50.707957 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0e9b543c-0ead-4c98-ac77-bddbd7c4b03e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:50.920658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0e9b543c-0ead-4c98-ac77-bddbd7c4b03e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:50.929246 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0e9b543c-0ead-4c98-ac77-bddbd7c4b03e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.234644 May 26 17:07:50.929826 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 512/1045] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:50 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:51.653833 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-de4c67b5-0049-4af7-a05d-4d8451372b50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:51.654568 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-de4c67b5-0049-4af7-a05d-4d8451372b50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:51.662083 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-de4c67b5-0049-4af7-a05d-4d8451372b50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:51.662642 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-de4c67b5-0049-4af7-a05d-4d8451372b50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:51.663488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-de4c67b5-0049-4af7-a05d-4d8451372b50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:51.663937 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-de4c67b5-0049-4af7-a05d-4d8451372b50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:51.682518 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:51.729277 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-de4c67b5-0049-4af7-a05d-4d8451372b50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:51.736800 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-de4c67b5-0049-4af7-a05d-4d8451372b50 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1626 microversion: 2.1 time: 0.086960 May 26 17:07:51.737611 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 534/1046] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:51 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1626 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:51.864661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-0547400d-8f37-4765-8bf0-4db9b0dfb585 req-83666bdb-42f2-4ba9-b701-70b2749108fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea078281-ddf9-4637-9cfd-ca0709e2e74d", "name": "network-vif-deleted", "tag": "43b6e144-5534-4897-b9ef-4e0176bc01ea"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:07:51.872800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-0547400d-8f37-4765-8bf0-4db9b0dfb585 req-83666bdb-42f2-4ba9-b701-70b2749108fe service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:51.873254 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-0547400d-8f37-4765-8bf0-4db9b0dfb585 req-83666bdb-42f2-4ba9-b701-70b2749108fe service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:51.885342 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-0547400d-8f37-4765-8bf0-4db9b0dfb585 req-83666bdb-42f2-4ba9-b701-70b2749108fe service nova] Creating event network-vif-deleted:43b6e144-5534-4897-b9ef-4e0176bc01ea for instance ea078281-ddf9-4637-9cfd-ca0709e2e74d on hv-cinder-83607 May 26 17:07:51.890661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-0547400d-8f37-4765-8bf0-4db9b0dfb585 req-83666bdb-42f2-4ba9-b701-70b2749108fe service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030079 May 26 17:07:51.891459 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 513/1047] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:07:51.947367 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-83f0104d-3bd9-4061-a3e3-879d4d8d87a6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:51.950222 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-83f0104d-3bd9-4061-a3e3-879d4d8d87a6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:51.955342 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-83f0104d-3bd9-4061-a3e3-879d4d8d87a6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:51.956552 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-83f0104d-3bd9-4061-a3e3-879d4d8d87a6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:51.957415 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-83f0104d-3bd9-4061-a3e3-879d4d8d87a6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:51.958705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-83f0104d-3bd9-4061-a3e3-879d4d8d87a6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:52.120015 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-83f0104d-3bd9-4061-a3e3-879d4d8d87a6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:52.127919 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-83f0104d-3bd9-4061-a3e3-879d4d8d87a6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.184458 May 26 17:07:52.138813 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 535/1048] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:51 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:52.754310 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6088471f-0f98-4f8e-9269-1e1de68cadbd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:52.754797 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6088471f-0f98-4f8e-9269-1e1de68cadbd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:52.761351 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6088471f-0f98-4f8e-9269-1e1de68cadbd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:52.762059 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6088471f-0f98-4f8e-9269-1e1de68cadbd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:52.763027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6088471f-0f98-4f8e-9269-1e1de68cadbd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:52.763699 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6088471f-0f98-4f8e-9269-1e1de68cadbd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:52.796425 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6088471f-0f98-4f8e-9269-1e1de68cadbd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:52.797116 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6088471f-0f98-4f8e-9269-1e1de68cadbd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:52.797639 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-6088471f-0f98-4f8e-9269-1e1de68cadbd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lazy-loading 'fault' on Instance uuid ea078281-ddf9-4637-9cfd-ca0709e2e74d {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:07:52.897817 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6088471f-0f98-4f8e-9269-1e1de68cadbd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:52.907495 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6088471f-0f98-4f8e-9269-1e1de68cadbd tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 200 len: 1339 microversion: 2.1 time: 0.157653 May 26 17:07:52.908429 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 514/1049] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:52 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 1339 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:53.145204 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-05878739-991d-4f05-a025-2e351004f838 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:53.151335 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-05878739-991d-4f05-a025-2e351004f838 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:53.152876 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-05878739-991d-4f05-a025-2e351004f838 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:53.153323 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-05878739-991d-4f05-a025-2e351004f838 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:53.154080 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-05878739-991d-4f05-a025-2e351004f838 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:53.154537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-05878739-991d-4f05-a025-2e351004f838 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:53.287200 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-05878739-991d-4f05-a025-2e351004f838 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:53.294625 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-05878739-991d-4f05-a025-2e351004f838 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.153468 May 26 17:07:53.295189 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 536/1050] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:53 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:53.924944 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c215da85-9d0b-4b1b-92d6-34d92363f3fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:53.925561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c215da85-9d0b-4b1b-92d6-34d92363f3fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: ea078281-ddf9-4637-9cfd-ca0709e2e74d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:53.933026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c215da85-9d0b-4b1b-92d6-34d92363f3fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:53.933478 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c215da85-9d0b-4b1b-92d6-34d92363f3fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:53.935055 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c215da85-9d0b-4b1b-92d6-34d92363f3fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:53.935055 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c215da85-9d0b-4b1b-92d6-34d92363f3fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:53.948553 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-c215da85-9d0b-4b1b-92d6-34d92363f3fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] HTTP exception thrown: Instance ea078281-ddf9-4637-9cfd-ca0709e2e74d could not be found. May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c215da85-9d0b-4b1b-92d6-34d92363f3fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Request method failure captured: May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d HTTP/1.1 May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7ICrWbJE07SpsbGPvKFPZcXYZJyQkTyQK4OS5UehWo0LNcTgmpOR54Ko5HnVJ6hxOPBMJ-Hz5oXWE0LemMPQsWnjPq2QVy-5mm_exw_ya8_ffr8b9Pc59qAlGdLrwBR2X4SFcLofYd8EHjWCjXO1KVOMsnHVkBFVQ6uIKvJUgf0IBo May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: d84da619d6f042ed8ccf92259d52e180 May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:07:53.950187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:07:53.951861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_d84da619d6f042ed8ccf92259d52e180"}]}] May 26 17:07:53.951861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:07:53.951861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: d84da619d6f042ed8ccf92259d52e180 May 26 17:07:53.951861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:07:53.951861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-ServerRescueNegativeTestJSON-1303393345-project May 26 17:07:53.951861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:07:53.951861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:07:53.951861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: a3ccb15b11de4cfea727f0aa453f6e2b May 26 17:07:53.951861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1303393345-project May 26 17:07:53.951861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:07:53.951861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance ea078281-ddf9-4637-9cfd-ca0709e2e74d could not be found. May 26 17:07:53.951861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': 'ea078281-ddf9-4637-9cfd-ca0709e2e74d'} May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea078281-ddf9-4637-9cfd-ca0709e2e74d could not be found. May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:07:53.952991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea078281-ddf9-4637-9cfd-ca0709e2e74d could not be found. May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea078281-ddf9-4637-9cfd-ca0709e2e74d could not be found. May 26 17:07:53.954541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:07:53.955881 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c215da85-9d0b-4b1b-92d6-34d92363f3fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Returning 404 to user: Instance ea078281-ddf9-4637-9cfd-ca0709e2e74d could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:07:53.955881 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c215da85-9d0b-4b1b-92d6-34d92363f3fc tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d" status: 404 len: 111 microversion: 2.1 time: 0.030540 May 26 17:07:53.955881 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 515/1051] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:53 2022] GET /compute/v2.1/servers/ea078281-ddf9-4637-9cfd-ca0709e2e74d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:07:53.960881 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2b49e204-17ab-4044-ae1b-3c81bbbaff5e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '.version_select at 0x7fd250f23e50>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:54.029503 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2b49e204-17ab-4044-ae1b-3c81bbbaff5e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-399033353" status: 202 len: 0 microversion: 2.1 time: 0.072778 May 26 17:07:54.030015 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 537/1052] 10.222.0.112 () {58 vars in 1222 bytes} [Thu May 26 17:07:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-399033353 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:07:54.313494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f302523b-f847-4c8a-ac6a-5264288883c6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:54.314686 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f302523b-f847-4c8a-ac6a-5264288883c6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:54.324896 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f302523b-f847-4c8a-ac6a-5264288883c6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:54.324896 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f302523b-f847-4c8a-ac6a-5264288883c6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:54.325993 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f302523b-f847-4c8a-ac6a-5264288883c6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:54.327298 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f302523b-f847-4c8a-ac6a-5264288883c6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:54.362156 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:54.572455 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f302523b-f847-4c8a-ac6a-5264288883c6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:54.580188 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f302523b-f847-4c8a-ac6a-5264288883c6 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.272177 May 26 17:07:54.580766 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 516/1053] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:54 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:55.569728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-505c55cd-8c44-484a-bec1-1b3b11afc255 req-208f2887-be24-4e0e-abc2-581ba1c3f334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d85e129-1f91-4dd5-a330-867543373c26", "name": "network-vif-plugged", "status": "completed", "tag": "5cf74066-ff82-453f-8a5c-8af488ca071d"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:07:55.578132 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-505c55cd-8c44-484a-bec1-1b3b11afc255 req-208f2887-be24-4e0e-abc2-581ba1c3f334 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:55.578606 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-505c55cd-8c44-484a-bec1-1b3b11afc255 req-208f2887-be24-4e0e-abc2-581ba1c3f334 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:55.590377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-505c55cd-8c44-484a-bec1-1b3b11afc255 req-208f2887-be24-4e0e-abc2-581ba1c3f334 service nova] Creating event network-vif-plugged:5cf74066-ff82-453f-8a5c-8af488ca071d for instance 1d85e129-1f91-4dd5-a330-867543373c26 on hv-cinder-83607 May 26 17:07:55.595588 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-505c55cd-8c44-484a-bec1-1b3b11afc255 req-208f2887-be24-4e0e-abc2-581ba1c3f334 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030875 May 26 17:07:55.596195 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 538/1054] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:07:55.600833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4b9c56ef-f3ab-411a-a0ef-171619db6fa9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:55.600833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4b9c56ef-f3ab-411a-a0ef-171619db6fa9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:55.606294 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4b9c56ef-f3ab-411a-a0ef-171619db6fa9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:55.606779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4b9c56ef-f3ab-411a-a0ef-171619db6fa9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:55.607606 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4b9c56ef-f3ab-411a-a0ef-171619db6fa9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:55.608050 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4b9c56ef-f3ab-411a-a0ef-171619db6fa9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:55.758630 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4b9c56ef-f3ab-411a-a0ef-171619db6fa9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:55.766018 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4b9c56ef-f3ab-411a-a0ef-171619db6fa9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.172971 May 26 17:07:55.766640 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 517/1055] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:55 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:07:56.784291 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ac695d4d-48e7-4a1d-96a3-f46facdbd6f3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:56.784993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ac695d4d-48e7-4a1d-96a3-f46facdbd6f3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:56.791843 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ac695d4d-48e7-4a1d-96a3-f46facdbd6f3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:56.792282 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ac695d4d-48e7-4a1d-96a3-f46facdbd6f3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:56.793045 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ac695d4d-48e7-4a1d-96a3-f46facdbd6f3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:56.793478 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ac695d4d-48e7-4a1d-96a3-f46facdbd6f3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:57.212128 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ac695d4d-48e7-4a1d-96a3-f46facdbd6f3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:57.218040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ac695d4d-48e7-4a1d-96a3-f46facdbd6f3 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.438477 May 26 17:07:57.218656 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 539/1056] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:56 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:57.444964 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4a7aa214-6486-40fd-bd5e-c712cedd7926 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:57.445815 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4a7aa214-6486-40fd-bd5e-c712cedd7926 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:57.456419 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a7aa214-6486-40fd-bd5e-c712cedd7926 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:57.456868 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a7aa214-6486-40fd-bd5e-c712cedd7926 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:57.458584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a7aa214-6486-40fd-bd5e-c712cedd7926 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:57.459330 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a7aa214-6486-40fd-bd5e-c712cedd7926 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:57.487901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4a7aa214-6486-40fd-bd5e-c712cedd7926 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Going to try to terminate instance {{(pid=130525) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:07:57.777106 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4a7aa214-6486-40fd-bd5e-c712cedd7926 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "DELETE /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 204 len: 0 microversion: 2.1 time: 0.336530 May 26 17:07:57.777605 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 518/1057] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:07:57 2022] DELETE /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:07:57.786483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-912e88b0-ebce-41c9-9c86-aaf8206e581b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:57.790595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-912e88b0-ebce-41c9-9c86-aaf8206e581b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:57.793752 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-912e88b0-ebce-41c9-9c86-aaf8206e581b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:57.794208 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-912e88b0-ebce-41c9-9c86-aaf8206e581b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:57.795008 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-912e88b0-ebce-41c9-9c86-aaf8206e581b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:57.795448 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-912e88b0-ebce-41c9-9c86-aaf8206e581b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:57.940135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-912e88b0-ebce-41c9-9c86-aaf8206e581b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:57.948277 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-912e88b0-ebce-41c9-9c86-aaf8206e581b tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1513 microversion: 2.1 time: 0.165774 May 26 17:07:57.948985 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 540/1058] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:57 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:58.236398 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-de174c12-ff6e-4b82-8b6f-4174e954efd2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:58.237140 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-de174c12-ff6e-4b82-8b6f-4174e954efd2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:58.244192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de174c12-ff6e-4b82-8b6f-4174e954efd2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:58.244636 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de174c12-ff6e-4b82-8b6f-4174e954efd2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:58.245393 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de174c12-ff6e-4b82-8b6f-4174e954efd2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:58.245825 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-de174c12-ff6e-4b82-8b6f-4174e954efd2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:58.388383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-de174c12-ff6e-4b82-8b6f-4174e954efd2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:58.395754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-de174c12-ff6e-4b82-8b6f-4174e954efd2 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1368 microversion: 2.1 time: 0.163760 May 26 17:07:58.396318 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 519/1059] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:58 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:58.968627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7a287c62-3aff-451e-9a05-eb24f01f7906 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:58.969286 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7a287c62-3aff-451e-9a05-eb24f01f7906 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:58.977080 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a287c62-3aff-451e-9a05-eb24f01f7906 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:58.977528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a287c62-3aff-451e-9a05-eb24f01f7906 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:58.978292 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a287c62-3aff-451e-9a05-eb24f01f7906 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:58.978750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a287c62-3aff-451e-9a05-eb24f01f7906 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:59.106353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7a287c62-3aff-451e-9a05-eb24f01f7906 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:59.115610 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7a287c62-3aff-451e-9a05-eb24f01f7906 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1513 microversion: 2.1 time: 0.151043 May 26 17:07:59.116220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 541/1060] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:58 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:59.412528 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ec2399e3-f519-4b06-a3d7-cceb4e17e0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:59.413132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ec2399e3-f519-4b06-a3d7-cceb4e17e0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:59.419609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ec2399e3-f519-4b06-a3d7-cceb4e17e0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:59.420050 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ec2399e3-f519-4b06-a3d7-cceb4e17e0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:59.420799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ec2399e3-f519-4b06-a3d7-cceb4e17e0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:59.421228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ec2399e3-f519-4b06-a3d7-cceb4e17e0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:59.561954 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ec2399e3-f519-4b06-a3d7-cceb4e17e0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:07:59.570184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ec2399e3-f519-4b06-a3d7-cceb4e17e0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1555 microversion: 2.1 time: 0.161563 May 26 17:07:59.570793 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 520/1061] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:07:59 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:07:59.587061 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ff6227e6-d7a5-4067-b3f1-e4f9eac5cc80 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:07:59.587558 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ff6227e6-d7a5-4067-b3f1-e4f9eac5cc80 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:07:59.593600 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ff6227e6-d7a5-4067-b3f1-e4f9eac5cc80 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:59.594051 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ff6227e6-d7a5-4067-b3f1-e4f9eac5cc80 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:59.594844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ff6227e6-d7a5-4067-b3f1-e4f9eac5cc80 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:07:59.595284 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ff6227e6-d7a5-4067-b3f1-e4f9eac5cc80 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:07:59.671114 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ff6227e6-d7a5-4067-b3f1-e4f9eac5cc80 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087968 May 26 17:07:59.671723 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 542/1062] 10.222.0.112 () {58 vars in 1279 bytes} [Thu May 26 17:07:59 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:08:00.132769 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d2cbd9ea-4d43-4735-8d35-a4ac59dd8b30 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:00.133408 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d2cbd9ea-4d43-4735-8d35-a4ac59dd8b30 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:00.139580 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d2cbd9ea-4d43-4735-8d35-a4ac59dd8b30 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:00.140028 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d2cbd9ea-4d43-4735-8d35-a4ac59dd8b30 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:00.140804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d2cbd9ea-4d43-4735-8d35-a4ac59dd8b30 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:00.141269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d2cbd9ea-4d43-4735-8d35-a4ac59dd8b30 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:00.467260 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d2cbd9ea-4d43-4735-8d35-a4ac59dd8b30 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:00.475288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d2cbd9ea-4d43-4735-8d35-a4ac59dd8b30 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1513 microversion: 2.1 time: 0.346646 May 26 17:08:00.475867 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 521/1063] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:00 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1513 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:00.867505 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-c2f9a970-72b0-4b86-8a4a-64b8cd0ba266 req-4702c43f-40b9-4250-8428-3bc63f9d018b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc8354d-7f45-4c4a-a590-aeadaad33115", "name": "network-vif-deleted", "tag": "ceb32ccc-6e72-46ab-9bdd-73afcc5aa54c"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:08:00.881052 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-c2f9a970-72b0-4b86-8a4a-64b8cd0ba266 req-4702c43f-40b9-4250-8428-3bc63f9d018b service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:00.881778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-c2f9a970-72b0-4b86-8a4a-64b8cd0ba266 req-4702c43f-40b9-4250-8428-3bc63f9d018b service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:00.894252 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-c2f9a970-72b0-4b86-8a4a-64b8cd0ba266 req-4702c43f-40b9-4250-8428-3bc63f9d018b service nova] Creating event network-vif-deleted:ceb32ccc-6e72-46ab-9bdd-73afcc5aa54c for instance dfc8354d-7f45-4c4a-a590-aeadaad33115 on hv-cinder-83607 May 26 17:08:00.900928 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-c2f9a970-72b0-4b86-8a4a-64b8cd0ba266 req-4702c43f-40b9-4250-8428-3bc63f9d018b service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039759 May 26 17:08:00.901845 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 543/1064] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:08:01.493297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8611399a-3a05-4c62-b310-89f41c931116 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:01.493993 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8611399a-3a05-4c62-b310-89f41c931116 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:01.500988 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8611399a-3a05-4c62-b310-89f41c931116 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:01.501446 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8611399a-3a05-4c62-b310-89f41c931116 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:01.502226 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8611399a-3a05-4c62-b310-89f41c931116 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:01.502732 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8611399a-3a05-4c62-b310-89f41c931116 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:01.534159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8611399a-3a05-4c62-b310-89f41c931116 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:01.534639 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8611399a-3a05-4c62-b310-89f41c931116 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:01.535113 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-8611399a-3a05-4c62-b310-89f41c931116 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lazy-loading 'fault' on Instance uuid dfc8354d-7f45-4c4a-a590-aeadaad33115 {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:08:01.577682 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8611399a-3a05-4c62-b310-89f41c931116 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:01.585140 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8611399a-3a05-4c62-b310-89f41c931116 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 200 len: 1316 microversion: 2.1 time: 0.096845 May 26 17:08:01.585712 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 522/1065] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:01 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 1316 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:02.603777 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-eb5efcfc-cb0c-44bc-9c69-c8f73d056be1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:02.604466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-eb5efcfc-cb0c-44bc-9c69-c8f73d056be1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: dfc8354d-7f45-4c4a-a590-aeadaad33115] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:02.611291 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eb5efcfc-cb0c-44bc-9c69-c8f73d056be1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:02.611739 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eb5efcfc-cb0c-44bc-9c69-c8f73d056be1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:02.612502 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eb5efcfc-cb0c-44bc-9c69-c8f73d056be1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:02.612937 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-eb5efcfc-cb0c-44bc-9c69-c8f73d056be1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:02.626799 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-eb5efcfc-cb0c-44bc-9c69-c8f73d056be1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] HTTP exception thrown: Instance dfc8354d-7f45-4c4a-a590-aeadaad33115 could not be found. May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-eb5efcfc-cb0c-44bc-9c69-c8f73d056be1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Request method failure captured: May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 HTTP/1.1 May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7ICrWbJE07SpsbGPvKFPZcXYZJyQkTyQK4OS5UehWo0LNcTgmpOR54Ko5HnVJ6hxOPBMJ-Hz5oXWE0LemMPQsWnjPq2QVy-5mm_exw_ya8_ffr8b9Pc59qAlGdLrwBR2X4SFcLofYd8EHjWCjXO1KVOMsnHVkBFVQ6uIKvJUgf0IBo May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: d84da619d6f042ed8ccf92259d52e180 May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:08:02.628439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:08:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_d84da619d6f042ed8ccf92259d52e180"}]}] May 26 17:08:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:08:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: d84da619d6f042ed8ccf92259d52e180 May 26 17:08:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:08:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-ServerRescueNegativeTestJSON-1303393345-project May 26 17:08:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:08:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:08:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: a3ccb15b11de4cfea727f0aa453f6e2b May 26 17:08:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1303393345-project May 26 17:08:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:08:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance dfc8354d-7f45-4c4a-a590-aeadaad33115 could not be found. May 26 17:08:02.629963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'dfc8354d-7f45-4c4a-a590-aeadaad33115'} May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc8354d-7f45-4c4a-a590-aeadaad33115 could not be found. May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:08:02.631066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc8354d-7f45-4c4a-a590-aeadaad33115 could not be found. May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc8354d-7f45-4c4a-a590-aeadaad33115 could not be found. May 26 17:08:02.632672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:02.634118 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-eb5efcfc-cb0c-44bc-9c69-c8f73d056be1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Returning 404 to user: Instance dfc8354d-7f45-4c4a-a590-aeadaad33115 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:08:02.634118 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-eb5efcfc-cb0c-44bc-9c69-c8f73d056be1 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115" status: 404 len: 111 microversion: 2.1 time: 0.032552 May 26 17:08:02.634118 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 544/1066] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:02 2022] GET /compute/v2.1/servers/dfc8354d-7f45-4c4a-a590-aeadaad33115 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:08:02.638997 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-77f7dd82-ffc9-450a-80d6-c4f87ebcc929 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:02.639528 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-77f7dd82-ffc9-450a-80d6-c4f87ebcc929 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:02.646588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-77f7dd82-ffc9-450a-80d6-c4f87ebcc929 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:02.647043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-77f7dd82-ffc9-450a-80d6-c4f87ebcc929 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:02.647813 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-77f7dd82-ffc9-450a-80d6-c4f87ebcc929 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:02.648254 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-77f7dd82-ffc9-450a-80d6-c4f87ebcc929 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:02.673026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-77f7dd82-ffc9-450a-80d6-c4f87ebcc929 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Going to try to terminate instance {{(pid=130525) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:08:02.915864 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-3fad6ada-43c9-4d07-ae82-1dc9f5f6bd70 req-ae58a5ec-81a5-4028-bc1f-8f52a8488a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d85e129-1f91-4dd5-a330-867543373c26", "tag": "5cf74066-ff82-453f-8a5c-8af488ca071d"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:08:02.924304 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-3fad6ada-43c9-4d07-ae82-1dc9f5f6bd70 req-ae58a5ec-81a5-4028-bc1f-8f52a8488a36 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:02.924751 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-3fad6ada-43c9-4d07-ae82-1dc9f5f6bd70 req-ae58a5ec-81a5-4028-bc1f-8f52a8488a36 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:02.936030 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-3fad6ada-43c9-4d07-ae82-1dc9f5f6bd70 req-ae58a5ec-81a5-4028-bc1f-8f52a8488a36 service nova] Creating event network-changed:5cf74066-ff82-453f-8a5c-8af488ca071d for instance 1d85e129-1f91-4dd5-a330-867543373c26 on hv-cinder-83607 May 26 17:08:02.940761 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-3fad6ada-43c9-4d07-ae82-1dc9f5f6bd70 req-ae58a5ec-81a5-4028-bc1f-8f52a8488a36 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028759 May 26 17:08:02.941348 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 545/1067] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:08:03.061249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-77f7dd82-ffc9-450a-80d6-c4f87ebcc929 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "DELETE /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 204 len: 0 microversion: 2.1 time: 0.425770 May 26 17:08:03.062017 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 523/1068] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:08:02 2022] DELETE /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:08:03.071663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0d320ebe-c8a8-44f6-92fd-894712b528c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:03.072564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0d320ebe-c8a8-44f6-92fd-894712b528c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:03.079043 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0d320ebe-c8a8-44f6-92fd-894712b528c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:03.079534 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0d320ebe-c8a8-44f6-92fd-894712b528c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:03.080307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0d320ebe-c8a8-44f6-92fd-894712b528c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:03.080749 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0d320ebe-c8a8-44f6-92fd-894712b528c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:03.219269 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0d320ebe-c8a8-44f6-92fd-894712b528c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:03.226817 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0d320ebe-c8a8-44f6-92fd-894712b528c3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.160390 May 26 17:08:03.227379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 546/1069] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:03 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:04.244935 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cd7f0050-e9a2-4caf-b403-13fa5957c89e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:04.245541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cd7f0050-e9a2-4caf-b403-13fa5957c89e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:04.252160 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd7f0050-e9a2-4caf-b403-13fa5957c89e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:04.252612 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd7f0050-e9a2-4caf-b403-13fa5957c89e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:04.253377 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd7f0050-e9a2-4caf-b403-13fa5957c89e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:04.253854 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd7f0050-e9a2-4caf-b403-13fa5957c89e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:04.484840 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cd7f0050-e9a2-4caf-b403-13fa5957c89e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:04.493928 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cd7f0050-e9a2-4caf-b403-13fa5957c89e tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1525 microversion: 2.1 time: 0.253252 May 26 17:08:04.494629 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 524/1070] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:04 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1525 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:04.955703 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-36f025ce-b00a-4fc9-b91f-78a0615d91fb req-0c866433-0dad-4a86-aaf6-ef2a8d9e7a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf36dc82-736a-4235-a29d-663f9341ab63", "name": "network-vif-deleted", "tag": "1b2abc71-4545-4f0e-a46c-881b6d72d6b9"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:08:04.969423 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-36f025ce-b00a-4fc9-b91f-78a0615d91fb req-0c866433-0dad-4a86-aaf6-ef2a8d9e7a12 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:04.970153 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-36f025ce-b00a-4fc9-b91f-78a0615d91fb req-0c866433-0dad-4a86-aaf6-ef2a8d9e7a12 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:04.983311 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-36f025ce-b00a-4fc9-b91f-78a0615d91fb req-0c866433-0dad-4a86-aaf6-ef2a8d9e7a12 service nova] Creating event network-vif-deleted:1b2abc71-4545-4f0e-a46c-881b6d72d6b9 for instance bf36dc82-736a-4235-a29d-663f9341ab63 on hv-cinder-83607 May 26 17:08:04.988076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-36f025ce-b00a-4fc9-b91f-78a0615d91fb req-0c866433-0dad-4a86-aaf6-ef2a8d9e7a12 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036376 May 26 17:08:04.989162 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 547/1071] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:08:05.511964 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-908257d3-4437-4571-b669-db7d4abecc44 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:05.512507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-908257d3-4437-4571-b669-db7d4abecc44 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:05.519090 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-908257d3-4437-4571-b669-db7d4abecc44 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:05.519532 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-908257d3-4437-4571-b669-db7d4abecc44 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:05.520446 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-908257d3-4437-4571-b669-db7d4abecc44 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:05.520879 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-908257d3-4437-4571-b669-db7d4abecc44 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:05.552794 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-908257d3-4437-4571-b669-db7d4abecc44 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:05.553235 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-908257d3-4437-4571-b669-db7d4abecc44 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:05.553668 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-908257d3-4437-4571-b669-db7d4abecc44 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lazy-loading 'fault' on Instance uuid bf36dc82-736a-4235-a29d-663f9341ab63 {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:08:05.596142 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-908257d3-4437-4571-b669-db7d4abecc44 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ccb15b11de4cfea727f0aa453f6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84da619d6f042ed8ccf92259d52e180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:05.604215 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-908257d3-4437-4571-b669-db7d4abecc44 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 200 len: 1315 microversion: 2.1 time: 0.096205 May 26 17:08:05.604785 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 525/1072] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:05 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 1315 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:06.622807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-35718031-680c-4d97-8848-3f57063e4ac3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:06.623455 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-35718031-680c-4d97-8848-3f57063e4ac3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] [instance: bf36dc82-736a-4235-a29d-663f9341ab63] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:06.629610 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-35718031-680c-4d97-8848-3f57063e4ac3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:06.630062 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-35718031-680c-4d97-8848-3f57063e4ac3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:06.630848 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-35718031-680c-4d97-8848-3f57063e4ac3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:06.631279 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-35718031-680c-4d97-8848-3f57063e4ac3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:06.644787 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-35718031-680c-4d97-8848-3f57063e4ac3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] HTTP exception thrown: Instance bf36dc82-736a-4235-a29d-663f9341ab63 could not be found. May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-35718031-680c-4d97-8848-3f57063e4ac3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Request method failure captured: May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 HTTP/1.1 May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7ICrWbJE07SpsbGPvKFPZcXYZJyQkTyQK4OS5UehWo0LNcTgmpOR54Ko5HnVJ6hxOPBMJ-Hz5oXWE0LemMPQsWnjPq2QVy-5mm_exw_ya8_ffr8b9Pc59qAlGdLrwBR2X4SFcLofYd8EHjWCjXO1KVOMsnHVkBFVQ6uIKvJUgf0IBo May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: d84da619d6f042ed8ccf92259d52e180 May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:08:06.646496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:08:06.648091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/d84da619d6f042ed8ccf92259d52e180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_d84da619d6f042ed8ccf92259d52e180"}]}] May 26 17:08:06.648091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:08:06.648091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: d84da619d6f042ed8ccf92259d52e180 May 26 17:08:06.648091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1303393345 May 26 17:08:06.648091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-ServerRescueNegativeTestJSON-1303393345-project May 26 17:08:06.648091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:08:06.648091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:08:06.648091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: a3ccb15b11de4cfea727f0aa453f6e2b May 26 17:08:06.648091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1303393345-project May 26 17:08:06.648091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:08:06.648091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance bf36dc82-736a-4235-a29d-663f9341ab63 could not be found. May 26 17:08:06.648091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'bf36dc82-736a-4235-a29d-663f9341ab63'} May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf36dc82-736a-4235-a29d-663f9341ab63 could not be found. May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:08:06.649123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf36dc82-736a-4235-a29d-663f9341ab63 could not be found. May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf36dc82-736a-4235-a29d-663f9341ab63 could not be found. May 26 17:08:06.650684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:06.652526 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-35718031-680c-4d97-8848-3f57063e4ac3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] Returning 404 to user: Instance bf36dc82-736a-4235-a29d-663f9341ab63 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:08:06.652526 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-35718031-680c-4d97-8848-3f57063e4ac3 tempest-ServerRescueNegativeTestJSON-1303393345 tempest-ServerRescueNegativeTestJSON-1303393345-project] 10.222.0.112 "GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63" status: 404 len: 111 microversion: 2.1 time: 0.029949 May 26 17:08:06.652526 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 548/1073] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:06 2022] GET /compute/v2.1/servers/bf36dc82-736a-4235-a29d-663f9341ab63 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:08:24.555743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=3 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:24.556805 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:24.766652 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b83ef81c-ba2d-4873-a27c-f0c089258fc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:24.767156 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b83ef81c-ba2d-4873-a27c-f0c089258fc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:24.774106 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b83ef81c-ba2d-4873-a27c-f0c089258fc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:24.774597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b83ef81c-ba2d-4873-a27c-f0c089258fc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:24.775380 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b83ef81c-ba2d-4873-a27c-f0c089258fc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:24.775815 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b83ef81c-ba2d-4873-a27c-f0c089258fc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:24.802634 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b83ef81c-ba2d-4873-a27c-f0c089258fc5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/ips" status: 200 len: 149 microversion: 2.1 time: 0.253011 May 26 17:08:24.803212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 526/1074] 10.222.0.112 () {58 vars in 1252 bytes} [Thu May 26 17:08:24 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/ips => generated 149 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:08:27.505061 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3fb3b477-ee11-4403-adfb-ee38ea1661f8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae608811-6970-472e-83d9-50024a66c527"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:08:27.506138 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3fb3b477-ee11-4403-adfb-ee38ea1661f8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:27.508457 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:27.509117 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=54 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:27.513832 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3fb3b477-ee11-4403-adfb-ee38ea1661f8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:27.514276 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3fb3b477-ee11-4403-adfb-ee38ea1661f8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:27.515082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3fb3b477-ee11-4403-adfb-ee38ea1661f8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:27.515513 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3fb3b477-ee11-4403-adfb-ee38ea1661f8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:28.628572 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3fb3b477-ee11-4403-adfb-ee38ea1661f8 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.127241 May 26 17:08:28.629544 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 549/1075] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:08:27 2022] POST /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments => generated 194 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:08:36.507359 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:36.789087 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6f2c84a0-ca75-4ba9-b97d-92f93e141247 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:36.789575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6f2c84a0-ca75-4ba9-b97d-92f93e141247 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:36.795523 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6f2c84a0-ca75-4ba9-b97d-92f93e141247 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:36.795971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6f2c84a0-ca75-4ba9-b97d-92f93e141247 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:36.796725 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6f2c84a0-ca75-4ba9-b97d-92f93e141247 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:36.797156 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6f2c84a0-ca75-4ba9-b97d-92f93e141247 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:36.819612 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6f2c84a0-ca75-4ba9-b97d-92f93e141247 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/ips" status: 200 len: 151 microversion: 2.20 time: 0.317775 May 26 17:08:36.820163 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 527/1076] 10.222.0.112 () {60 vars in 1293 bytes} [Thu May 26 17:08:36 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/ips => generated 151 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:08:37.239090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6e956e8d-65f2-4bff-a134-65ac2973a72c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae608811-6970-472e-83d9-50024a66c527"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:08:37.239090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6e956e8d-65f2-4bff-a134-65ac2973a72c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:37.242453 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6e956e8d-65f2-4bff-a134-65ac2973a72c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:37.242910 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6e956e8d-65f2-4bff-a134-65ac2973a72c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:37.243690 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6e956e8d-65f2-4bff-a134-65ac2973a72c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:37.244127 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6e956e8d-65f2-4bff-a134-65ac2973a72c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:37.323466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-6e956e8d-65f2-4bff-a134-65ac2973a72c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Invalid volume: volume ae608811-6970-472e-83d9-50024a66c527 is already attached to instances: bb71ce55-ab15-4719-9bd9-3cf739fb322a May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6e956e8d-65f2-4bff-a134-65ac2973a72c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: POST /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments HTTP/1.1 May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 74 May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:08:37.325224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:08:37.327188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:08:37.327188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:08:37.327188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:08:37.327188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:08:37.327188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:08:37.327188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:08:37.327188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:08:37.327188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:08:37.327188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:08:37.327188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: May 26 17:08:37.327188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {"volumeAttachment": {"volumeId": "ae608811-6970-472e-83d9-50024a66c527"}} May 26 17:08:37.327188 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Invalid volume: volume ae608811-6970-472e-83d9-50024a66c527 is already attached to instances: bb71ce55-ab15-4719-9bd9-3cf739fb322a May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'server_id': 'bb71ce55-ab15-4719-9bd9-3cf739fb322a', 'body': {'volumeAttachment': {'volumeId': 'ae608811-6970-472e-83d9-50024a66c527'}}} May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ae608811-6970-472e-83d9-50024a66c527 is already attached to instances: bb71ce55-ab15-4719-9bd9-3cf739fb322a May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:37.328076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ae608811-6970-472e-83d9-50024a66c527 is already attached to instances: bb71ce55-ab15-4719-9bd9-3cf739fb322a May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:08:37.329537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:08:37.331564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:08:37.331564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:08:37.331564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:08:37.331564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ae608811-6970-472e-83d9-50024a66c527 is already attached to instances: bb71ce55-ab15-4719-9bd9-3cf739fb322a May 26 17:08:37.331564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:37.331564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6e956e8d-65f2-4bff-a134-65ac2973a72c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 400 to user: Invalid volume: volume ae608811-6970-472e-83d9-50024a66c527 is already attached to instances: bb71ce55-ab15-4719-9bd9-3cf739fb322a {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:08:37.331564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6e956e8d-65f2-4bff-a134-65ac2973a72c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097946 May 26 17:08:37.331564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 550/1077] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:08:37 2022] POST /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 17:08:37.393136 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-dd53596c-8d22-4aa8-9266-f6b0f729f0a4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:37.393579 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-dd53596c-8d22-4aa8-9266-f6b0f729f0a4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:37.400354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dd53596c-8d22-4aa8-9266-f6b0f729f0a4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:37.400814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dd53596c-8d22-4aa8-9266-f6b0f729f0a4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:37.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dd53596c-8d22-4aa8-9266-f6b0f729f0a4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:37.402034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dd53596c-8d22-4aa8-9266-f6b0f729f0a4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:37.484496 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-dd53596c-8d22-4aa8-9266-f6b0f729f0a4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lazy-loading 'services' on Instance uuid bb71ce55-ab15-4719-9bd9-3cf739fb322a {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:08:37.746198 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-dd53596c-8d22-4aa8-9266-f6b0f729f0a4 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments/ae608811-6970-472e-83d9-50024a66c527" status: 202 len: 0 microversion: 2.1 time: 0.356801 May 26 17:08:37.747006 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 528/1078] 10.222.0.112 () {58 vars in 1420 bytes} [Thu May 26 17:08:37 2022] DELETE /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments/ae608811-6970-472e-83d9-50024a66c527 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:08:37.756078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d859e662-b307-4d55-a31a-2afe8fc62591 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:37.757989 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d859e662-b307-4d55-a31a-2afe8fc62591 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:37.764351 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d859e662-b307-4d55-a31a-2afe8fc62591 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:37.764783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d859e662-b307-4d55-a31a-2afe8fc62591 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:37.765769 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d859e662-b307-4d55-a31a-2afe8fc62591 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:37.766510 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d859e662-b307-4d55-a31a-2afe8fc62591 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:37.796971 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d859e662-b307-4d55-a31a-2afe8fc62591 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045724 May 26 17:08:37.797529 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 551/1079] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:08:37 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:08:38.810616 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-42b19836-d7d8-40c2-bcb8-e6db4b83fcf6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:38.811609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-42b19836-d7d8-40c2-bcb8-e6db4b83fcf6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:38.819511 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-42b19836-d7d8-40c2-bcb8-e6db4b83fcf6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:38.819964 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-42b19836-d7d8-40c2-bcb8-e6db4b83fcf6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:38.820746 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-42b19836-d7d8-40c2-bcb8-e6db4b83fcf6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:38.821239 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-42b19836-d7d8-40c2-bcb8-e6db4b83fcf6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:38.860743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-42b19836-d7d8-40c2-bcb8-e6db4b83fcf6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055091 May 26 17:08:38.861445 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 529/1080] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:08:38 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:08:39.874826 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8585668e-8a68-4ab1-8d2a-c6a40f84e11f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:39.875770 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8585668e-8a68-4ab1-8d2a-c6a40f84e11f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:39.883028 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8585668e-8a68-4ab1-8d2a-c6a40f84e11f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:39.883487 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8585668e-8a68-4ab1-8d2a-c6a40f84e11f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:39.884258 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8585668e-8a68-4ab1-8d2a-c6a40f84e11f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:39.884694 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8585668e-8a68-4ab1-8d2a-c6a40f84e11f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:39.912967 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8585668e-8a68-4ab1-8d2a-c6a40f84e11f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043428 May 26 17:08:39.913526 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 552/1081] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:08:39 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:08:40.034120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-06e03f94-ed7a-4f69-95da-6cfd50c526bb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:40.035242 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-06e03f94-ed7a-4f69-95da-6cfd50c526bb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:40.041587 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-06e03f94-ed7a-4f69-95da-6cfd50c526bb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:40.042041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-06e03f94-ed7a-4f69-95da-6cfd50c526bb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:40.042926 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-06e03f94-ed7a-4f69-95da-6cfd50c526bb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:40.043370 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-06e03f94-ed7a-4f69-95da-6cfd50c526bb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:40.069302 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-06e03f94-ed7a-4f69-95da-6cfd50c526bb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Going to try to terminate instance {{(pid=130525) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:08:40.316443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-06e03f94-ed7a-4f69-95da-6cfd50c526bb tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 204 len: 0 microversion: 2.1 time: 0.286303 May 26 17:08:40.317048 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 530/1082] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:08:40 2022] DELETE /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:08:40.325324 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5980f5ed-776a-4e00-a0d1-29b69e0f0c34 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:40.326179 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5980f5ed-776a-4e00-a0d1-29b69e0f0c34 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:40.332614 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5980f5ed-776a-4e00-a0d1-29b69e0f0c34 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:40.333053 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5980f5ed-776a-4e00-a0d1-29b69e0f0c34 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:40.334018 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5980f5ed-776a-4e00-a0d1-29b69e0f0c34 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:40.334478 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5980f5ed-776a-4e00-a0d1-29b69e0f0c34 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:40.469025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5980f5ed-776a-4e00-a0d1-29b69e0f0c34 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:40.478144 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5980f5ed-776a-4e00-a0d1-29b69e0f0c34 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1686 microversion: 2.1 time: 0.156809 May 26 17:08:40.479051 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 553/1083] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:40 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:40.869465 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e15daa5e-19d6-439e-9804-c25fced2462f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:08:40.870126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e15daa5e-19d6-439e-9804-c25fced2462f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:40.876274 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e15daa5e-19d6-439e-9804-c25fced2462f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:40.877870 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e15daa5e-19d6-439e-9804-c25fced2462f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:40.877870 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e15daa5e-19d6-439e-9804-c25fced2462f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:40.878639 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e15daa5e-19d6-439e-9804-c25fced2462f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:40.901889 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-e15daa5e-19d6-439e-9804-c25fced2462f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lazy-loading 'flavor' on Instance uuid 4dca66e2-797a-492c-aa32-e2bb881ac25b {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:08:41.471513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e15daa5e-19d6-439e-9804-c25fced2462f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "POST /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/action" status: 202 len: 0 microversion: 2.20 time: 0.606351 May 26 17:08:41.472164 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 531/1084] 10.222.0.112 () {62 vars in 1323 bytes} [Thu May 26 17:08:40 2022] POST /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 17:08:41.480359 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-421202a1-78db-4642-b467-5856204a9853 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:41.481093 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-421202a1-78db-4642-b467-5856204a9853 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:41.487581 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-421202a1-78db-4642-b467-5856204a9853 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:41.488664 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-421202a1-78db-4642-b467-5856204a9853 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:41.489433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-421202a1-78db-4642-b467-5856204a9853 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:41.489872 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-421202a1-78db-4642-b467-5856204a9853 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:41.496065 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f36702b8-a6a7-4a7c-9cf5-2ecd03b7a050 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:41.496771 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f36702b8-a6a7-4a7c-9cf5-2ecd03b7a050 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:41.503198 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f36702b8-a6a7-4a7c-9cf5-2ecd03b7a050 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:41.504703 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f36702b8-a6a7-4a7c-9cf5-2ecd03b7a050 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:41.505252 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f36702b8-a6a7-4a7c-9cf5-2ecd03b7a050 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:41.505692 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f36702b8-a6a7-4a7c-9cf5-2ecd03b7a050 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:41.625310 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-421202a1-78db-4642-b467-5856204a9853 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:41.633674 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-421202a1-78db-4642-b467-5856204a9853 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:41.635213 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-421202a1-78db-4642-b467-5856204a9853 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:41.636392 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-421202a1-78db-4642-b467-5856204a9853 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.159986 May 26 17:08:41.636955 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 554/1085] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:41 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:08:41.642848 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f36702b8-a6a7-4a7c-9cf5-2ecd03b7a050 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:41.650613 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f36702b8-a6a7-4a7c-9cf5-2ecd03b7a050 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1686 microversion: 2.1 time: 0.158740 May 26 17:08:41.651178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 532/1086] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:41 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:08:42.655211 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-222e1891-f224-4bf6-b533-fd576e3889b0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:42.655824 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-222e1891-f224-4bf6-b533-fd576e3889b0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:42.663070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-222e1891-f224-4bf6-b533-fd576e3889b0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:42.663522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-222e1891-f224-4bf6-b533-fd576e3889b0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:42.664293 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-222e1891-f224-4bf6-b533-fd576e3889b0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:42.664731 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-222e1891-f224-4bf6-b533-fd576e3889b0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:42.669015 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3287af1d-e8f4-4005-b7c8-d666b5dfbdbf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:42.669627 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3287af1d-e8f4-4005-b7c8-d666b5dfbdbf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:42.676074 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3287af1d-e8f4-4005-b7c8-d666b5dfbdbf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:42.676524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3287af1d-e8f4-4005-b7c8-d666b5dfbdbf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:42.677362 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3287af1d-e8f4-4005-b7c8-d666b5dfbdbf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:42.677788 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3287af1d-e8f4-4005-b7c8-d666b5dfbdbf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:42.797009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-222e1891-f224-4bf6-b533-fd576e3889b0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:42.805062 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-222e1891-f224-4bf6-b533-fd576e3889b0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:42.806607 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-222e1891-f224-4bf6-b533-fd576e3889b0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:42.807908 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-222e1891-f224-4bf6-b533-fd576e3889b0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.156492 May 26 17:08:42.808341 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 555/1087] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:42 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:08:42.810399 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3287af1d-e8f4-4005-b7c8-d666b5dfbdbf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:42.818059 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3287af1d-e8f4-4005-b7c8-d666b5dfbdbf tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1686 microversion: 2.1 time: 0.152773 May 26 17:08:42.818656 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 533/1088] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:42 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:08:43.827030 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-08967967-f777-4a41-a151-34e313d077f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:43.827645 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-08967967-f777-4a41-a151-34e313d077f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:43.835504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-08967967-f777-4a41-a151-34e313d077f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:43.835960 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-08967967-f777-4a41-a151-34e313d077f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:43.836734 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-08967967-f777-4a41-a151-34e313d077f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:43.837180 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-08967967-f777-4a41-a151-34e313d077f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:43.838887 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-04897b65-5baa-496e-ab6f-330b825e58fc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:43.839499 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-04897b65-5baa-496e-ab6f-330b825e58fc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:43.845944 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-04897b65-5baa-496e-ab6f-330b825e58fc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:43.846428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-04897b65-5baa-496e-ab6f-330b825e58fc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:43.847186 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-04897b65-5baa-496e-ab6f-330b825e58fc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:43.849125 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-04897b65-5baa-496e-ab6f-330b825e58fc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:43.986311 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-04897b65-5baa-496e-ab6f-330b825e58fc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:43.992468 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-04897b65-5baa-496e-ab6f-330b825e58fc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1686 microversion: 2.1 time: 0.157400 May 26 17:08:43.993064 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 534/1089] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:43 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:08:43.993761 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-08967967-f777-4a41-a151-34e313d077f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:44.002148 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-08967967-f777-4a41-a151-34e313d077f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:44.003710 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-08967967-f777-4a41-a151-34e313d077f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:44.004937 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-08967967-f777-4a41-a151-34e313d077f7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.182240 May 26 17:08:44.005580 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 556/1090] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:43 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:08:45.009383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cd91ba48-2f81-497c-a839-14639ef66ade tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:45.010084 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cd91ba48-2f81-497c-a839-14639ef66ade tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:45.016805 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd91ba48-2f81-497c-a839-14639ef66ade tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:45.017259 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd91ba48-2f81-497c-a839-14639ef66ade tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:45.018031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd91ba48-2f81-497c-a839-14639ef66ade tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:45.018515 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cd91ba48-2f81-497c-a839-14639ef66ade tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:45.023713 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-12bf018a-a13c-43d0-9d34-c31bab11fca3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:45.024327 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-12bf018a-a13c-43d0-9d34-c31bab11fca3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:45.030732 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12bf018a-a13c-43d0-9d34-c31bab11fca3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:45.031180 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12bf018a-a13c-43d0-9d34-c31bab11fca3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:45.031995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12bf018a-a13c-43d0-9d34-c31bab11fca3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:45.032431 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12bf018a-a13c-43d0-9d34-c31bab11fca3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:45.153472 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cd91ba48-2f81-497c-a839-14639ef66ade tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:45.162608 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cd91ba48-2f81-497c-a839-14639ef66ade tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1686 microversion: 2.1 time: 0.156890 May 26 17:08:45.163187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 535/1091] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:45 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:45.166699 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-12bf018a-a13c-43d0-9d34-c31bab11fca3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:45.174516 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-12bf018a-a13c-43d0-9d34-c31bab11fca3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:45.176052 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-12bf018a-a13c-43d0-9d34-c31bab11fca3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:45.177865 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-12bf018a-a13c-43d0-9d34-c31bab11fca3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.158619 May 26 17:08:45.178438 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 557/1092] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:45 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:08:46.180504 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a927b041-3a43-4a28-94b7-87df16895b31 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:46.181129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a927b041-3a43-4a28-94b7-87df16895b31 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:46.187653 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a927b041-3a43-4a28-94b7-87df16895b31 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:46.188101 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a927b041-3a43-4a28-94b7-87df16895b31 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:46.188869 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a927b041-3a43-4a28-94b7-87df16895b31 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:46.189345 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a927b041-3a43-4a28-94b7-87df16895b31 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:46.196294 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-da3ec74a-f5b6-469a-9e0a-78f7ce8b3f72 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:46.200199 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-da3ec74a-f5b6-469a-9e0a-78f7ce8b3f72 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:46.203968 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-da3ec74a-f5b6-469a-9e0a-78f7ce8b3f72 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:46.204430 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-da3ec74a-f5b6-469a-9e0a-78f7ce8b3f72 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:46.205211 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-da3ec74a-f5b6-469a-9e0a-78f7ce8b3f72 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:46.205642 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-da3ec74a-f5b6-469a-9e0a-78f7ce8b3f72 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:46.329572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a927b041-3a43-4a28-94b7-87df16895b31 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:46.337676 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a927b041-3a43-4a28-94b7-87df16895b31 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1686 microversion: 2.1 time: 0.161671 May 26 17:08:46.338258 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 536/1093] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:46 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:46.338700 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-da3ec74a-f5b6-469a-9e0a-78f7ce8b3f72 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:46.346774 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-da3ec74a-f5b6-469a-9e0a-78f7ce8b3f72 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:46.348895 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-da3ec74a-f5b6-469a-9e0a-78f7ce8b3f72 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:46.350096 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-da3ec74a-f5b6-469a-9e0a-78f7ce8b3f72 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.158080 May 26 17:08:46.350689 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 558/1094] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:46 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:08:47.355555 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-94d03563-f072-45a6-845e-bb9d034842e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:47.356118 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-94d03563-f072-45a6-845e-bb9d034842e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:47.363495 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-94d03563-f072-45a6-845e-bb9d034842e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:47.364480 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-94d03563-f072-45a6-845e-bb9d034842e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:47.365826 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-94d03563-f072-45a6-845e-bb9d034842e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:47.366344 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-94d03563-f072-45a6-845e-bb9d034842e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:47.369808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8bc1211d-6c94-4a06-b280-1970e901d530 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:47.370626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8bc1211d-6c94-4a06-b280-1970e901d530 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:47.377748 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8bc1211d-6c94-4a06-b280-1970e901d530 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:47.378580 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8bc1211d-6c94-4a06-b280-1970e901d530 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:47.380369 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8bc1211d-6c94-4a06-b280-1970e901d530 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:47.381072 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8bc1211d-6c94-4a06-b280-1970e901d530 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:47.533935 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8bc1211d-6c94-4a06-b280-1970e901d530 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:47.542566 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8bc1211d-6c94-4a06-b280-1970e901d530 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:47.544074 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8bc1211d-6c94-4a06-b280-1970e901d530 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:47.545250 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8bc1211d-6c94-4a06-b280-1970e901d530 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.180015 May 26 17:08:47.545861 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 559/1095] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:47 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:08:47.635399 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-94d03563-f072-45a6-845e-bb9d034842e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:47.642827 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-94d03563-f072-45a6-845e-bb9d034842e2 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1686 microversion: 2.1 time: 0.291599 May 26 17:08:47.644148 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 537/1096] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:47 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1686 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:48.184252 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-4ad6080a-2b29-4ac6-b5f0-536b4c258fc4 req-d4a785db-4153-4731-9568-d53b7edc5082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb71ce55-ab15-4719-9bd9-3cf739fb322a", "name": "network-vif-deleted", "tag": "c3955ac2-f683-4fbc-80a5-c28be909bd65"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:08:48.193507 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-4ad6080a-2b29-4ac6-b5f0-536b4c258fc4 req-d4a785db-4153-4731-9568-d53b7edc5082 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:48.195470 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-4ad6080a-2b29-4ac6-b5f0-536b4c258fc4 req-d4a785db-4153-4731-9568-d53b7edc5082 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:48.214122 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-4ad6080a-2b29-4ac6-b5f0-536b4c258fc4 req-d4a785db-4153-4731-9568-d53b7edc5082 service nova] Creating event network-vif-deleted:c3955ac2-f683-4fbc-80a5-c28be909bd65 for instance bb71ce55-ab15-4719-9bd9-3cf739fb322a on hv-cinder-83607 May 26 17:08:48.217870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-4ad6080a-2b29-4ac6-b5f0-536b4c258fc4 req-d4a785db-4153-4731-9568-d53b7edc5082 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037256 May 26 17:08:48.218581 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 560/1097] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:08:48.564511 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-74b96e00-fccc-4ba2-ac18-25e301ba6cc3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:48.565221 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-74b96e00-fccc-4ba2-ac18-25e301ba6cc3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:48.573063 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-74b96e00-fccc-4ba2-ac18-25e301ba6cc3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:48.573916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-74b96e00-fccc-4ba2-ac18-25e301ba6cc3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:48.575131 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-74b96e00-fccc-4ba2-ac18-25e301ba6cc3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:48.575300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-74b96e00-fccc-4ba2-ac18-25e301ba6cc3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:48.662678 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-aea9e9c6-9699-4195-bf0f-d14f88a45ce1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:48.663389 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-aea9e9c6-9699-4195-bf0f-d14f88a45ce1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:48.670752 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aea9e9c6-9699-4195-bf0f-d14f88a45ce1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:48.671349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aea9e9c6-9699-4195-bf0f-d14f88a45ce1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:48.672149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aea9e9c6-9699-4195-bf0f-d14f88a45ce1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:48.672866 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aea9e9c6-9699-4195-bf0f-d14f88a45ce1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:48.712603 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aea9e9c6-9699-4195-bf0f-d14f88a45ce1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:48.713289 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aea9e9c6-9699-4195-bf0f-d14f88a45ce1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:48.714009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-aea9e9c6-9699-4195-bf0f-d14f88a45ce1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lazy-loading 'fault' on Instance uuid bb71ce55-ab15-4719-9bd9-3cf739fb322a {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:08:48.741099 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-74b96e00-fccc-4ba2-ac18-25e301ba6cc3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:48.749993 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:48.753735 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-74b96e00-fccc-4ba2-ac18-25e301ba6cc3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:48.758004 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-74b96e00-fccc-4ba2-ac18-25e301ba6cc3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:48.759212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-74b96e00-fccc-4ba2-ac18-25e301ba6cc3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.199079 May 26 17:08:48.759880 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 538/1098] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:48 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:08:48.762709 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-aea9e9c6-9699-4195-bf0f-d14f88a45ce1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:48.772828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-aea9e9c6-9699-4195-bf0f-d14f88a45ce1 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 200 len: 1336 microversion: 2.1 time: 0.115335 May 26 17:08:48.775623 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 561/1099] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:48 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 1336 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:08:49.778243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-53513abd-9e62-4098-aa7c-dd5741240cae tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:49.778890 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-53513abd-9e62-4098-aa7c-dd5741240cae tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:49.786047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-53513abd-9e62-4098-aa7c-dd5741240cae tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:49.786701 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-53513abd-9e62-4098-aa7c-dd5741240cae tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:49.787485 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-53513abd-9e62-4098-aa7c-dd5741240cae tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:49.787926 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-53513abd-9e62-4098-aa7c-dd5741240cae tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:49.791022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4958e570-0186-438c-b110-15f6c834de1c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:49.791640 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4958e570-0186-438c-b110-15f6c834de1c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:49.798494 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4958e570-0186-438c-b110-15f6c834de1c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:49.798946 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4958e570-0186-438c-b110-15f6c834de1c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:49.799756 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4958e570-0186-438c-b110-15f6c834de1c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:49.801152 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4958e570-0186-438c-b110-15f6c834de1c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:49.814289 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-4958e570-0186-438c-b110-15f6c834de1c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4958e570-0186-438c-b110-15f6c834de1c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a HTTP/1.1 May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:08:49.815988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:08:49.818728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:08:49.818728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:08:49.818728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:08:49.818728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:08:49.818728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:08:49.818728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:08:49.818728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:08:49.818728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:08:49.818728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:08:49.818728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:08:49.818728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:08:49.818728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'bb71ce55-ab15-4719-9bd9-3cf739fb322a'} May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:08:49.819827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:08:49.821340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:08:49.822721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4958e570-0186-438c-b110-15f6c834de1c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 404 to user: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:08:49.822721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4958e570-0186-438c-b110-15f6c834de1c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 404 len: 111 microversion: 2.1 time: 0.030969 May 26 17:08:49.822721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 562/1100] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:49 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:08:49.827303 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-18f070be-fd3f-4e56-baa3-e05035784618 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '.version_select at 0x7fd250fde670>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:49.919166 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-18f070be-fd3f-4e56-baa3-e05035784618 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089767892" status: 202 len: 0 microversion: 2.1 time: 0.095701 May 26 17:08:49.919890 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 563/1101] 10.222.0.112 () {58 vars in 1225 bytes} [Thu May 26 17:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089767892 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:08:49.929892 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-53513abd-9e62-4098-aa7c-dd5741240cae tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:49.938006 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-53513abd-9e62-4098-aa7c-dd5741240cae tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:49.939526 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-53513abd-9e62-4098-aa7c-dd5741240cae tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:49.940689 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-53513abd-9e62-4098-aa7c-dd5741240cae tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.166913 May 26 17:08:49.941251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 539/1102] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:49 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:08:50.697696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9d25db94-76bf-4f91-af04-b2903691a402 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: .version_select at 0x7fd2524e58b0>, body: {"keypair": {"name": "tempest-keypair-494471729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx5JdY6PpzS2tNkEZsPloSWcr8ED9J+HzNWVu/UveT83IeFXNFb2qnRw0lyozpsQdM3f7K2aXu2tppF8Shvq/qmYusr1+sxtQwd6IMEqE6ZQZ/CTkbyUwk6+5CgWHwiDw=="}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:08:50.712333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-9d25db94-76bf-4f91-af04-b2903691a402 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'key_pairs'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:08:50.716244 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-9d25db94-76bf-4f91-af04-b2903691a402 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for user 289cb250e20344d28bd5fd17255d5896 and project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'key_pairs'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:08:50.851913 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9d25db94-76bf-4f91-af04-b2903691a402 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157994 May 26 17:08:50.852672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 564/1103] 10.222.0.112 () {60 vars in 1163 bytes} [Thu May 26 17:08:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:08:50.961449 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b4ff50b4-e1d7-4dfd-81d4-e9704607c453 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:50.962006 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b4ff50b4-e1d7-4dfd-81d4-e9704607c453 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:50.968651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b4ff50b4-e1d7-4dfd-81d4-e9704607c453 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:50.969101 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b4ff50b4-e1d7-4dfd-81d4-e9704607c453 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:50.969878 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b4ff50b4-e1d7-4dfd-81d4-e9704607c453 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:50.970312 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b4ff50b4-e1d7-4dfd-81d4-e9704607c453 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:51.113499 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b4ff50b4-e1d7-4dfd-81d4-e9704607c453 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:51.122409 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b4ff50b4-e1d7-4dfd-81d4-e9704607c453 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:51.126083 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b4ff50b4-e1d7-4dfd-81d4-e9704607c453 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:51.126083 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b4ff50b4-e1d7-4dfd-81d4-e9704607c453 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.169144 May 26 17:08:51.126083 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 540/1104] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:50 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:08:52.144676 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-022d148e-83b6-4936-8c49-750a9c7b0ad0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:52.145893 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-022d148e-83b6-4936-8c49-750a9c7b0ad0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:52.154466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-022d148e-83b6-4936-8c49-750a9c7b0ad0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:52.155065 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-022d148e-83b6-4936-8c49-750a9c7b0ad0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:52.155965 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-022d148e-83b6-4936-8c49-750a9c7b0ad0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:52.156456 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-022d148e-83b6-4936-8c49-750a9c7b0ad0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:52.297022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-022d148e-83b6-4936-8c49-750a9c7b0ad0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:52.307381 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-022d148e-83b6-4936-8c49-750a9c7b0ad0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:52.309351 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-022d148e-83b6-4936-8c49-750a9c7b0ad0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:52.310653 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-022d148e-83b6-4936-8c49-750a9c7b0ad0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.170727 May 26 17:08:52.311363 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 565/1105] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:52 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:08:53.311230 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-332481773", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "685d481c-e3f1-425b-9a28-548fe43d099c"}], "security_groups": [{"name": "tempest-securitygroup--1502981098"}], "key_name": "tempest-keypair-494471729", "user_data": "}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:08:53.332115 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-17f49ef8-7e09-4a23-829c-0817ee88ee3c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:53.333800 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-17f49ef8-7e09-4a23-829c-0817ee88ee3c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:53.343601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17f49ef8-7e09-4a23-829c-0817ee88ee3c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:53.344394 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17f49ef8-7e09-4a23-829c-0817ee88ee3c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:53.345560 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17f49ef8-7e09-4a23-829c-0817ee88ee3c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:53.346236 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17f49ef8-7e09-4a23-829c-0817ee88ee3c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:53.430341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] validate_networks() for [('685d481c-e3f1-425b-9a28-548fe43d099c', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:08:53.518831 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-17f49ef8-7e09-4a23-829c-0817ee88ee3c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:53.528196 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-17f49ef8-7e09-4a23-829c-0817ee88ee3c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:53.529699 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-17f49ef8-7e09-4a23-829c-0817ee88ee3c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:53.530932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-17f49ef8-7e09-4a23-829c-0817ee88ee3c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.205528 May 26 17:08:53.531514 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 566/1106] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:53 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:08:54.069323 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:08:54.069770 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:08:54.070249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:08:54.070685 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:08:54.071092 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:08:54.080253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:54.080676 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:54.081462 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:54.081892 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:54.098036 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:08:54.102155 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Getting quotas for user 289cb250e20344d28bd5fd17255d5896 and project e6412eea680c4b2bbcac2efb59aabe52. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:08:54.116166 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:08:54.118447 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:08:54.229716 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-967bfa33-1028-421b-ad8d-e379ad7f101d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.922694 May 26 17:08:54.230588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 541/1107] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:08:53 2022] POST /compute/v2.1/servers => generated 404 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 17:08:54.241203 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-37e059ab-9c12-4e30-8490-5bc6871b94b9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:54.242135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-37e059ab-9c12-4e30-8490-5bc6871b94b9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:54.306359 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-37e059ab-9c12-4e30-8490-5bc6871b94b9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:54.314413 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-37e059ab-9c12-4e30-8490-5bc6871b94b9 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1244 microversion: 2.1 time: 0.077762 May 26 17:08:54.320262 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 567/1108] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:54 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1244 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:54.553134 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b5baef50-b61d-445e-914c-db6647a22e54 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:54.553802 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b5baef50-b61d-445e-914c-db6647a22e54 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:54.561184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b5baef50-b61d-445e-914c-db6647a22e54 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:54.561728 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b5baef50-b61d-445e-914c-db6647a22e54 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:54.562632 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b5baef50-b61d-445e-914c-db6647a22e54 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:54.563117 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b5baef50-b61d-445e-914c-db6647a22e54 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:54.704091 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b5baef50-b61d-445e-914c-db6647a22e54 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:54.714298 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b5baef50-b61d-445e-914c-db6647a22e54 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:54.716180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b5baef50-b61d-445e-914c-db6647a22e54 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:54.717561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b5baef50-b61d-445e-914c-db6647a22e54 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.170070 May 26 17:08:54.718248 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 542/1109] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:54 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:08:55.332667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2ec45fd3-4d15-4270-b574-87fc04ff84e6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:55.333577 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2ec45fd3-4d15-4270-b574-87fc04ff84e6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:55.340390 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2ec45fd3-4d15-4270-b574-87fc04ff84e6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:55.344489 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2ec45fd3-4d15-4270-b574-87fc04ff84e6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:55.344489 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2ec45fd3-4d15-4270-b574-87fc04ff84e6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:55.344489 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2ec45fd3-4d15-4270-b574-87fc04ff84e6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:55.346874 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:55.403542 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2ec45fd3-4d15-4270-b574-87fc04ff84e6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:55.411435 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2ec45fd3-4d15-4270-b574-87fc04ff84e6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1248 microversion: 2.1 time: 0.083216 May 26 17:08:55.411988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 568/1110] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:55 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:55.740689 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-04469dfe-c899-490c-9c2f-287b0066be04 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:55.741778 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-04469dfe-c899-490c-9c2f-287b0066be04 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:55.753213 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-04469dfe-c899-490c-9c2f-287b0066be04 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:55.754375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-04469dfe-c899-490c-9c2f-287b0066be04 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:55.755813 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-04469dfe-c899-490c-9c2f-287b0066be04 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:55.756375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-04469dfe-c899-490c-9c2f-287b0066be04 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:55.891113 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-04469dfe-c899-490c-9c2f-287b0066be04 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:55.900927 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-04469dfe-c899-490c-9c2f-287b0066be04 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:55.902648 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-04469dfe-c899-490c-9c2f-287b0066be04 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:55.903965 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-04469dfe-c899-490c-9c2f-287b0066be04 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.171279 May 26 17:08:55.904587 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 543/1111] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:55 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:08:56.428595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-48b9121d-f801-45a5-aca9-9c590956fb3a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:56.429269 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-48b9121d-f801-45a5-aca9-9c590956fb3a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:56.436343 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48b9121d-f801-45a5-aca9-9c590956fb3a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:56.436780 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48b9121d-f801-45a5-aca9-9c590956fb3a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:56.437534 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48b9121d-f801-45a5-aca9-9c590956fb3a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:56.437961 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-48b9121d-f801-45a5-aca9-9c590956fb3a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:56.503574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-48b9121d-f801-45a5-aca9-9c590956fb3a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:56.511604 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-48b9121d-f801-45a5-aca9-9c590956fb3a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1296 microversion: 2.1 time: 0.086904 May 26 17:08:56.512174 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 569/1112] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:56 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:56.820344 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1247382744", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2141156347", "security_groups": [{"name": "tempest-secgroup-smoke-1976980798"}], "block_device_mapping_v2": [{"uuid": "11c1420c-499c-45d1-8355-1856219a3aa4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "73acc420-8851-42b7-81fc-cd9808652b9c"}]}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:08:56.923805 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-72566fbf-d6c1-4204-bbc4-22808417eaf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:56.924755 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-72566fbf-d6c1-4204-bbc4-22808417eaf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:56.933337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-72566fbf-d6c1-4204-bbc4-22808417eaf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:56.934176 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-72566fbf-d6c1-4204-bbc4-22808417eaf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:56.935398 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-72566fbf-d6c1-4204-bbc4-22808417eaf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:56.936151 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-72566fbf-d6c1-4204-bbc4-22808417eaf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:57.031529 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] validate_networks() for [('73acc420-8851-42b7-81fc-cd9808652b9c', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:08:57.111777 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-72566fbf-d6c1-4204-bbc4-22808417eaf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:57.121110 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-72566fbf-d6c1-4204-bbc4-22808417eaf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:57.122870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-72566fbf-d6c1-4204-bbc4-22808417eaf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:57.124181 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-72566fbf-d6c1-4204-bbc4-22808417eaf5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.205029 May 26 17:08:57.125142 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 570/1113] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:56 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:08:57.529255 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6bb4ed4f-6ce1-4caf-bf07-fa761508fc87 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:57.529870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6bb4ed4f-6ce1-4caf-bf07-fa761508fc87 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:57.537673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6bb4ed4f-6ce1-4caf-bf07-fa761508fc87 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:57.538130 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6bb4ed4f-6ce1-4caf-bf07-fa761508fc87 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:57.539160 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6bb4ed4f-6ce1-4caf-bf07-fa761508fc87 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:57.539606 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6bb4ed4f-6ce1-4caf-bf07-fa761508fc87 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:57.620470 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6bb4ed4f-6ce1-4caf-bf07-fa761508fc87 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:57.633422 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6bb4ed4f-6ce1-4caf-bf07-fa761508fc87 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1302 microversion: 2.1 time: 0.107806 May 26 17:08:57.634259 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 571/1114] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:57 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1302 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:08:57.762386 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:08:57.762823 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:08:57.763503 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:08:57.764046 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:08:57.764438 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:08:57.780588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:57.781109 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:57.782536 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:57.783228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:57.807641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Getting quotas for project ed4f536fcafe46b5ae159b93acb7e041. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:08:57.811736 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Getting quotas for user 530b2b1951644755afd1432381cf37f9 and project ed4f536fcafe46b5ae159b93acb7e041. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:08:57.895786 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:08:57.899626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11c1420c-499c-45d1-8355-1856219a3aa4',volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:08:58.142956 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-cbde050a-6dd4-4159-9291-e0409f566a1d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:58.143604 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-cbde050a-6dd4-4159-9291-e0409f566a1d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:58.145566 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:58.150754 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cbde050a-6dd4-4159-9291-e0409f566a1d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:58.151172 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cbde050a-6dd4-4159-9291-e0409f566a1d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:58.151947 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cbde050a-6dd4-4159-9291-e0409f566a1d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:58.152418 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-cbde050a-6dd4-4159-9291-e0409f566a1d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:58.341383 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cbde050a-6dd4-4159-9291-e0409f566a1d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:58.360874 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cbde050a-6dd4-4159-9291-e0409f566a1d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:58.362771 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-cbde050a-6dd4-4159-9291-e0409f566a1d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:58.364755 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-cbde050a-6dd4-4159-9291-e0409f566a1d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.225840 May 26 17:08:58.365826 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 572/1115] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:58 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:08:58.464300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-356d0032-c9c5-4d9e-8bf6-59043278b445 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.649994 May 26 17:08:58.465288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 544/1116] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:08:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:08:58.479664 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-768075d9-5819-4a0f-aa48-9820e38de05d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:58.480582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-768075d9-5819-4a0f-aa48-9820e38de05d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:58.557204 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-768075d9-5819-4a0f-aa48-9820e38de05d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:58.566481 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-768075d9-5819-4a0f-aa48-9820e38de05d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1098 microversion: 2.1 time: 0.093905 May 26 17:08:58.567646 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 573/1117] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:58 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1098 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:08:58.657004 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-12dacc7b-8549-4e4b-b9c0-0fe4696db167 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:58.658064 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-12dacc7b-8549-4e4b-b9c0-0fe4696db167 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:58.666285 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-12dacc7b-8549-4e4b-b9c0-0fe4696db167 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:58.667021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-12dacc7b-8549-4e4b-b9c0-0fe4696db167 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:58.667968 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-12dacc7b-8549-4e4b-b9c0-0fe4696db167 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:58.668569 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-12dacc7b-8549-4e4b-b9c0-0fe4696db167 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:58.902498 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-12dacc7b-8549-4e4b-b9c0-0fe4696db167 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:58.912126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-12dacc7b-8549-4e4b-b9c0-0fe4696db167 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1370 microversion: 2.1 time: 0.259386 May 26 17:08:58.916286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 545/1118] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:58 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:59.386563 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-555d0f17-e3f7-42ee-b9ae-11ae4913baf3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:59.387599 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-555d0f17-e3f7-42ee-b9ae-11ae4913baf3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:59.396706 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-555d0f17-e3f7-42ee-b9ae-11ae4913baf3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:59.398020 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-555d0f17-e3f7-42ee-b9ae-11ae4913baf3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:59.399788 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-555d0f17-e3f7-42ee-b9ae-11ae4913baf3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:59.400421 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-555d0f17-e3f7-42ee-b9ae-11ae4913baf3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:59.558185 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-00857e47-eda9-471c-90de-4519de6a34af req-48b8cdfc-3b5d-4808-871e-52f1ba14561a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c01d7d7-3fc2-4327-b3e7-f8415b2d323f", "tag": "9dcd846e-cfa0-472b-9e6d-3b7b0aa8c2c9"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:08:59.561006 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-555d0f17-e3f7-42ee-b9ae-11ae4913baf3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:59.570637 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-00857e47-eda9-471c-90de-4519de6a34af req-48b8cdfc-3b5d-4808-871e-52f1ba14561a service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:59.571170 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-00857e47-eda9-471c-90de-4519de6a34af req-48b8cdfc-3b5d-4808-871e-52f1ba14561a service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:59.573205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-555d0f17-e3f7-42ee-b9ae-11ae4913baf3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:59.575082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-555d0f17-e3f7-42ee-b9ae-11ae4913baf3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:59.586776 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-555d0f17-e3f7-42ee-b9ae-11ae4913baf3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.194485 May 26 17:08:59.586776 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 574/1119] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:08:59 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:08:59.594217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-87874f74-6ac3-4f36-9c67-25dc93caffcf tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:59.594898 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-87874f74-6ac3-4f36-9c67-25dc93caffcf tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:59.602257 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-87874f74-6ac3-4f36-9c67-25dc93caffcf tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:59.602751 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-87874f74-6ac3-4f36-9c67-25dc93caffcf tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:59.603713 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-87874f74-6ac3-4f36-9c67-25dc93caffcf tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:59.604316 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-87874f74-6ac3-4f36-9c67-25dc93caffcf tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:59.604631 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-00857e47-eda9-471c-90de-4519de6a34af req-48b8cdfc-3b5d-4808-871e-52f1ba14561a service nova] Creating event network-changed:9dcd846e-cfa0-472b-9e6d-3b7b0aa8c2c9 for instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f on hv-cinder-83607 May 26 17:08:59.611711 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-00857e47-eda9-471c-90de-4519de6a34af req-48b8cdfc-3b5d-4808-871e-52f1ba14561a service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061739 May 26 17:08:59.612454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 546/1120] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:08:59.680207 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-87874f74-6ac3-4f36-9c67-25dc93caffcf tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:08:59.689564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-87874f74-6ac3-4f36-9c67-25dc93caffcf tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1148 microversion: 2.1 time: 0.100885 May 26 17:08:59.690282 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 575/1121] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:59 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1148 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:08:59.930868 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0a504bba-41cd-43e7-aa13-3ac274c18ff6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:08:59.931480 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0a504bba-41cd-43e7-aa13-3ac274c18ff6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:08:59.938526 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0a504bba-41cd-43e7-aa13-3ac274c18ff6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:59.938979 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0a504bba-41cd-43e7-aa13-3ac274c18ff6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:08:59.939754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0a504bba-41cd-43e7-aa13-3ac274c18ff6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:08:59.940186 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0a504bba-41cd-43e7-aa13-3ac274c18ff6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:00.094515 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0a504bba-41cd-43e7-aa13-3ac274c18ff6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:00.103748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0a504bba-41cd-43e7-aa13-3ac274c18ff6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1370 microversion: 2.1 time: 0.178105 May 26 17:09:00.104349 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 547/1122] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:08:59 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:09:00.600634 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-092b195b-0414-4719-b365-8e82bb6d09da tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:00.601255 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-092b195b-0414-4719-b365-8e82bb6d09da tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:00.607811 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-092b195b-0414-4719-b365-8e82bb6d09da tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:00.608261 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-092b195b-0414-4719-b365-8e82bb6d09da tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:00.609040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-092b195b-0414-4719-b365-8e82bb6d09da tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:00.609480 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-092b195b-0414-4719-b365-8e82bb6d09da tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:00.710049 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-95df265f-9397-4a2e-9a0f-af5c29a5ee60 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:00.710620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-95df265f-9397-4a2e-9a0f-af5c29a5ee60 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:00.717289 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-95df265f-9397-4a2e-9a0f-af5c29a5ee60 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:00.717801 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-95df265f-9397-4a2e-9a0f-af5c29a5ee60 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:00.718785 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-95df265f-9397-4a2e-9a0f-af5c29a5ee60 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:00.719347 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-95df265f-9397-4a2e-9a0f-af5c29a5ee60 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:00.757356 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-092b195b-0414-4719-b365-8e82bb6d09da tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:00.772358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-092b195b-0414-4719-b365-8e82bb6d09da tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:00.775671 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-092b195b-0414-4719-b365-8e82bb6d09da tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:00.778036 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-092b195b-0414-4719-b365-8e82bb6d09da tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.181908 May 26 17:09:00.779239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 576/1123] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:00 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:00.871174 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-95df265f-9397-4a2e-9a0f-af5c29a5ee60 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:00.887329 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-95df265f-9397-4a2e-9a0f-af5c29a5ee60 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1196 microversion: 2.1 time: 0.181182 May 26 17:09:00.888264 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 548/1124] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:00 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1196 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:09:01.121342 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e8feef59-dc18-48ba-bd8e-35b0cccd129f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:01.122229 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e8feef59-dc18-48ba-bd8e-35b0cccd129f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:01.129041 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8feef59-dc18-48ba-bd8e-35b0cccd129f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:01.129545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8feef59-dc18-48ba-bd8e-35b0cccd129f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:01.130282 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8feef59-dc18-48ba-bd8e-35b0cccd129f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:01.130733 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e8feef59-dc18-48ba-bd8e-35b0cccd129f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:01.274226 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e8feef59-dc18-48ba-bd8e-35b0cccd129f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:01.282044 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e8feef59-dc18-48ba-bd8e-35b0cccd129f tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1370 microversion: 2.1 time: 0.164541 May 26 17:09:01.282667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 577/1125] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:01 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:01.806677 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f17a1eb9-aee2-4415-9b37-ea7f86371f0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:01.807259 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f17a1eb9-aee2-4415-9b37-ea7f86371f0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:01.813775 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f17a1eb9-aee2-4415-9b37-ea7f86371f0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:01.814220 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f17a1eb9-aee2-4415-9b37-ea7f86371f0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:01.815034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f17a1eb9-aee2-4415-9b37-ea7f86371f0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:01.815460 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f17a1eb9-aee2-4415-9b37-ea7f86371f0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:01.905095 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f58a3e77-3fdf-406c-b95b-a8980b9f4110 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:01.905712 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f58a3e77-3fdf-406c-b95b-a8980b9f4110 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:01.913113 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f58a3e77-3fdf-406c-b95b-a8980b9f4110 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:01.913561 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f58a3e77-3fdf-406c-b95b-a8980b9f4110 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:01.918475 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f58a3e77-3fdf-406c-b95b-a8980b9f4110 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:01.918475 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f58a3e77-3fdf-406c-b95b-a8980b9f4110 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:01.952891 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f17a1eb9-aee2-4415-9b37-ea7f86371f0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:01.962104 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f17a1eb9-aee2-4415-9b37-ea7f86371f0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:01.963628 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f17a1eb9-aee2-4415-9b37-ea7f86371f0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:01.964791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f17a1eb9-aee2-4415-9b37-ea7f86371f0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.162143 May 26 17:09:01.965351 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 549/1126] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:01 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:01.979076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f58a3e77-3fdf-406c-b95b-a8980b9f4110 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:01.986972 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f58a3e77-3fdf-406c-b95b-a8980b9f4110 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1204 microversion: 2.1 time: 0.085628 May 26 17:09:01.987586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 578/1127] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:01 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1204 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:09:02.298927 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e6814976-063c-45a0-8481-0a1e945c0993 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:02.299530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e6814976-063c-45a0-8481-0a1e945c0993 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:02.305986 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6814976-063c-45a0-8481-0a1e945c0993 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:02.306474 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6814976-063c-45a0-8481-0a1e945c0993 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:02.307225 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6814976-063c-45a0-8481-0a1e945c0993 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:02.307660 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e6814976-063c-45a0-8481-0a1e945c0993 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:02.446218 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e6814976-063c-45a0-8481-0a1e945c0993 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:02.453984 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e6814976-063c-45a0-8481-0a1e945c0993 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1370 microversion: 2.1 time: 0.158836 May 26 17:09:02.454512 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 550/1128] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:02 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:02.984362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9463f6ff-a9e6-4009-90c6-b7e84d5c1b83 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:02.984966 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9463f6ff-a9e6-4009-90c6-b7e84d5c1b83 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:02.992078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9463f6ff-a9e6-4009-90c6-b7e84d5c1b83 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:02.992519 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9463f6ff-a9e6-4009-90c6-b7e84d5c1b83 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:02.993273 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9463f6ff-a9e6-4009-90c6-b7e84d5c1b83 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:02.993699 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9463f6ff-a9e6-4009-90c6-b7e84d5c1b83 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:03.005394 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-66f4479f-720a-42ed-a8c3-521674fb0103 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:03.006409 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-66f4479f-720a-42ed-a8c3-521674fb0103 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:03.013735 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-66f4479f-720a-42ed-a8c3-521674fb0103 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:03.014196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-66f4479f-720a-42ed-a8c3-521674fb0103 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:03.015147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-66f4479f-720a-42ed-a8c3-521674fb0103 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:03.015662 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-66f4479f-720a-42ed-a8c3-521674fb0103 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:03.085144 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-66f4479f-720a-42ed-a8c3-521674fb0103 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:03.092864 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-66f4479f-720a-42ed-a8c3-521674fb0103 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1204 microversion: 2.1 time: 0.092405 May 26 17:09:03.093449 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 551/1129] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:02 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1204 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:09:03.132880 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9463f6ff-a9e6-4009-90c6-b7e84d5c1b83 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:03.140909 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9463f6ff-a9e6-4009-90c6-b7e84d5c1b83 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:03.142422 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9463f6ff-a9e6-4009-90c6-b7e84d5c1b83 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:03.143592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9463f6ff-a9e6-4009-90c6-b7e84d5c1b83 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.163167 May 26 17:09:03.144287 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 579/1130] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:02 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:03.470877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ed42064b-d24c-4df5-8022-ae02986d580e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:03.471516 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ed42064b-d24c-4df5-8022-ae02986d580e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:03.478690 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed42064b-d24c-4df5-8022-ae02986d580e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:03.479135 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed42064b-d24c-4df5-8022-ae02986d580e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:03.479896 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed42064b-d24c-4df5-8022-ae02986d580e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:03.480327 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed42064b-d24c-4df5-8022-ae02986d580e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:03.614357 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ed42064b-d24c-4df5-8022-ae02986d580e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:03.621636 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ed42064b-d24c-4df5-8022-ae02986d580e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1370 microversion: 2.1 time: 0.154585 May 26 17:09:03.622195 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 552/1131] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:03 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:04.109591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-56276e45-9e69-4b28-8f21-3e11eab398e2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:04.110189 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-56276e45-9e69-4b28-8f21-3e11eab398e2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:04.117009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-56276e45-9e69-4b28-8f21-3e11eab398e2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:04.117453 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-56276e45-9e69-4b28-8f21-3e11eab398e2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:04.118233 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-56276e45-9e69-4b28-8f21-3e11eab398e2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:04.118694 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-56276e45-9e69-4b28-8f21-3e11eab398e2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:04.162724 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9e9cdc8e-69b3-4bd9-85b8-1544940b4bc2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:04.163405 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9e9cdc8e-69b3-4bd9-85b8-1544940b4bc2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:04.169942 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9e9cdc8e-69b3-4bd9-85b8-1544940b4bc2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:04.170423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9e9cdc8e-69b3-4bd9-85b8-1544940b4bc2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:04.171195 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9e9cdc8e-69b3-4bd9-85b8-1544940b4bc2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:04.171634 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9e9cdc8e-69b3-4bd9-85b8-1544940b4bc2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:04.184496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-56276e45-9e69-4b28-8f21-3e11eab398e2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:04.193379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-56276e45-9e69-4b28-8f21-3e11eab398e2 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1204 microversion: 2.1 time: 0.087645 May 26 17:09:04.194023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 580/1132] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:04 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1204 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:04.319281 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9e9cdc8e-69b3-4bd9-85b8-1544940b4bc2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:04.329007 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9e9cdc8e-69b3-4bd9-85b8-1544940b4bc2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:04.330576 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9e9cdc8e-69b3-4bd9-85b8-1544940b4bc2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:04.332407 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9e9cdc8e-69b3-4bd9-85b8-1544940b4bc2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.173844 May 26 17:09:04.332971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 553/1133] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:04 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:09:04.638612 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6dbf489e-b5d7-456d-b849-68b784dff34c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:04.639843 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6dbf489e-b5d7-456d-b849-68b784dff34c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:04.647133 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6dbf489e-b5d7-456d-b849-68b784dff34c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:04.647693 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6dbf489e-b5d7-456d-b849-68b784dff34c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:04.648668 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6dbf489e-b5d7-456d-b849-68b784dff34c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:04.649180 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6dbf489e-b5d7-456d-b849-68b784dff34c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:04.814718 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6dbf489e-b5d7-456d-b849-68b784dff34c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:04.825445 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6dbf489e-b5d7-456d-b849-68b784dff34c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1370 microversion: 2.1 time: 0.190499 May 26 17:09:04.832290 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 581/1134] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:04 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:05.218099 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-95f2180e-d332-4d90-9ce3-7feb34345e9e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:05.219359 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-95f2180e-d332-4d90-9ce3-7feb34345e9e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:05.226623 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-95f2180e-d332-4d90-9ce3-7feb34345e9e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:05.227068 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-95f2180e-d332-4d90-9ce3-7feb34345e9e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:05.227833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-95f2180e-d332-4d90-9ce3-7feb34345e9e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:05.228258 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-95f2180e-d332-4d90-9ce3-7feb34345e9e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:05.306125 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-95f2180e-d332-4d90-9ce3-7feb34345e9e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:05.313677 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-95f2180e-d332-4d90-9ce3-7feb34345e9e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1214 microversion: 2.1 time: 0.099331 May 26 17:09:05.314267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 554/1135] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:05 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:09:05.351821 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b64a0227-5089-4935-abed-b47320ade81c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:05.352605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b64a0227-5089-4935-abed-b47320ade81c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:05.359200 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b64a0227-5089-4935-abed-b47320ade81c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:05.359649 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b64a0227-5089-4935-abed-b47320ade81c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:05.360412 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b64a0227-5089-4935-abed-b47320ade81c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:05.360845 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b64a0227-5089-4935-abed-b47320ade81c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:05.526512 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b64a0227-5089-4935-abed-b47320ade81c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:05.537834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b64a0227-5089-4935-abed-b47320ade81c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:05.540562 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b64a0227-5089-4935-abed-b47320ade81c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:05.541878 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b64a0227-5089-4935-abed-b47320ade81c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.194661 May 26 17:09:05.542482 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 582/1136] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:05 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:05.843624 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-42f203f1-39a2-4444-bf50-0b806303cf90 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:05.844288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-42f203f1-39a2-4444-bf50-0b806303cf90 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:05.853514 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-42f203f1-39a2-4444-bf50-0b806303cf90 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:05.853956 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-42f203f1-39a2-4444-bf50-0b806303cf90 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:05.854755 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-42f203f1-39a2-4444-bf50-0b806303cf90 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:05.855192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-42f203f1-39a2-4444-bf50-0b806303cf90 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:06.005055 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-42f203f1-39a2-4444-bf50-0b806303cf90 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:06.012644 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-42f203f1-39a2-4444-bf50-0b806303cf90 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1370 microversion: 2.1 time: 0.172905 May 26 17:09:06.013216 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 555/1137] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:05 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:09:06.331411 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7a06ca4f-63aa-4ebe-a02c-fdc7778ab883 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:06.331970 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7a06ca4f-63aa-4ebe-a02c-fdc7778ab883 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:06.337996 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a06ca4f-63aa-4ebe-a02c-fdc7778ab883 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:06.338482 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a06ca4f-63aa-4ebe-a02c-fdc7778ab883 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:06.339244 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a06ca4f-63aa-4ebe-a02c-fdc7778ab883 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:06.339679 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7a06ca4f-63aa-4ebe-a02c-fdc7778ab883 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:06.475581 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7a06ca4f-63aa-4ebe-a02c-fdc7778ab883 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:06.483323 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7a06ca4f-63aa-4ebe-a02c-fdc7778ab883 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1282 microversion: 2.1 time: 0.155946 May 26 17:09:06.483887 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 583/1138] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:06 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:06.560345 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ac707dfa-1741-4936-838c-6b2b06ed0e0d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:06.560951 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ac707dfa-1741-4936-838c-6b2b06ed0e0d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:06.568239 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ac707dfa-1741-4936-838c-6b2b06ed0e0d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:06.568669 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ac707dfa-1741-4936-838c-6b2b06ed0e0d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:06.569431 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ac707dfa-1741-4936-838c-6b2b06ed0e0d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:06.569860 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ac707dfa-1741-4936-838c-6b2b06ed0e0d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:06.768580 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ac707dfa-1741-4936-838c-6b2b06ed0e0d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:06.778310 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ac707dfa-1741-4936-838c-6b2b06ed0e0d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:06.780397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ac707dfa-1741-4936-838c-6b2b06ed0e0d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:06.781980 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ac707dfa-1741-4936-838c-6b2b06ed0e0d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.225583 May 26 17:09:06.782775 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 556/1139] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:06 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:07.030007 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-336aceac-f648-472c-b443-11db7c671300 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:07.030840 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-336aceac-f648-472c-b443-11db7c671300 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:07.039860 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-336aceac-f648-472c-b443-11db7c671300 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:07.040433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-336aceac-f648-472c-b443-11db7c671300 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:07.041431 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-336aceac-f648-472c-b443-11db7c671300 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:07.041991 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-336aceac-f648-472c-b443-11db7c671300 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:07.189783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-336aceac-f648-472c-b443-11db7c671300 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:07.197660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-336aceac-f648-472c-b443-11db7c671300 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1370 microversion: 2.1 time: 0.171789 May 26 17:09:07.198230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 584/1140] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:07 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:07.500733 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ebcb31a7-a53c-4c49-bdf3-579dee03ff26 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:07.501345 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ebcb31a7-a53c-4c49-bdf3-579dee03ff26 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:07.504148 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:07.510794 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ebcb31a7-a53c-4c49-bdf3-579dee03ff26 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:07.512857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ebcb31a7-a53c-4c49-bdf3-579dee03ff26 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:07.512857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ebcb31a7-a53c-4c49-bdf3-579dee03ff26 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:07.512857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ebcb31a7-a53c-4c49-bdf3-579dee03ff26 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:07.536246 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:07.690997 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-49a916af-2054-4e96-be53-048a1e5df236 req-dde60f82-2e8f-4a97-8e52-d2f65760cfeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c01d7d7-3fc2-4327-b3e7-f8415b2d323f", "name": "network-vif-plugged", "status": "completed", "tag": "9dcd846e-cfa0-472b-9e6d-3b7b0aa8c2c9"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:09:07.705676 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-49a916af-2054-4e96-be53-048a1e5df236 req-dde60f82-2e8f-4a97-8e52-d2f65760cfeb service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:07.706827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-49a916af-2054-4e96-be53-048a1e5df236 req-dde60f82-2e8f-4a97-8e52-d2f65760cfeb service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:07.720163 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-49a916af-2054-4e96-be53-048a1e5df236 req-dde60f82-2e8f-4a97-8e52-d2f65760cfeb service nova] Creating event network-vif-plugged:9dcd846e-cfa0-472b-9e6d-3b7b0aa8c2c9 for instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f on hv-cinder-83607 May 26 17:09:07.726203 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-49a916af-2054-4e96-be53-048a1e5df236 req-dde60f82-2e8f-4a97-8e52-d2f65760cfeb service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042695 May 26 17:09:07.727357 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 585/1141] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:09:07.764591 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ebcb31a7-a53c-4c49-bdf3-579dee03ff26 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:07.773469 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ebcb31a7-a53c-4c49-bdf3-579dee03ff26 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.276613 May 26 17:09:07.774054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 557/1142] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:07 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:07.802360 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4a05bda3-c499-4a94-bb56-e433d41e03b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:07.803100 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4a05bda3-c499-4a94-bb56-e433d41e03b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:07.814997 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4a05bda3-c499-4a94-bb56-e433d41e03b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:07.816383 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4a05bda3-c499-4a94-bb56-e433d41e03b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:07.818163 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4a05bda3-c499-4a94-bb56-e433d41e03b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:07.819058 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4a05bda3-c499-4a94-bb56-e433d41e03b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:07.847688 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:07.889530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-c6674a2c-d016-4add-8a8c-8529aff0e21a req-46ae2b6b-18ff-40ad-96a7-d540c103a56d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674dca1d-7dd2-42f4-8ddc-f9742a6d688d", "tag": "0ca04129-6455-4066-a7dd-a0f93617531c"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:09:07.910578 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=4 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:07.911716 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=12 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:07.920048 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-c6674a2c-d016-4add-8a8c-8529aff0e21a req-46ae2b6b-18ff-40ad-96a7-d540c103a56d service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:07.921075 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-c6674a2c-d016-4add-8a8c-8529aff0e21a req-46ae2b6b-18ff-40ad-96a7-d540c103a56d service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:07.943552 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-c6674a2c-d016-4add-8a8c-8529aff0e21a req-46ae2b6b-18ff-40ad-96a7-d540c103a56d service nova] Creating event network-changed:0ca04129-6455-4066-a7dd-a0f93617531c for instance 674dca1d-7dd2-42f4-8ddc-f9742a6d688d on hv-cinder-83607 May 26 17:09:07.953759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-c6674a2c-d016-4add-8a8c-8529aff0e21a req-46ae2b6b-18ff-40ad-96a7-d540c103a56d service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068576 May 26 17:09:07.955419 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 558/1143] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:09:08.033558 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4a05bda3-c499-4a94-bb56-e433d41e03b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:08.048143 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4a05bda3-c499-4a94-bb56-e433d41e03b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:08.051052 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4a05bda3-c499-4a94-bb56-e433d41e03b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:08.052582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4a05bda3-c499-4a94-bb56-e433d41e03b7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1749 microversion: 2.20 time: 0.255630 May 26 17:09:08.053321 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 586/1144] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:07 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1749 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:08.220218 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9a89731a-087c-4097-976b-72861ccf5fb6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:08.221061 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9a89731a-087c-4097-976b-72861ccf5fb6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:08.231896 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9a89731a-087c-4097-976b-72861ccf5fb6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:08.232872 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9a89731a-087c-4097-976b-72861ccf5fb6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:08.234259 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9a89731a-087c-4097-976b-72861ccf5fb6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:08.235140 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9a89731a-087c-4097-976b-72861ccf5fb6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:08.498291 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9a89731a-087c-4097-976b-72861ccf5fb6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:08.511218 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9a89731a-087c-4097-976b-72861ccf5fb6 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1370 microversion: 2.1 time: 0.296717 May 26 17:09:08.511807 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 559/1145] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:08 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1370 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:08.791166 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c5014fe5-e7f6-4b9a-bcdb-299671a55d83 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:08.791695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c5014fe5-e7f6-4b9a-bcdb-299671a55d83 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:08.793592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=8 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:08.798904 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5014fe5-e7f6-4b9a-bcdb-299671a55d83 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:08.802446 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5014fe5-e7f6-4b9a-bcdb-299671a55d83 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:08.802446 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5014fe5-e7f6-4b9a-bcdb-299671a55d83 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:08.802446 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5014fe5-e7f6-4b9a-bcdb-299671a55d83 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:08.936887 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c5014fe5-e7f6-4b9a-bcdb-299671a55d83 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:08.944748 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c5014fe5-e7f6-4b9a-bcdb-299671a55d83 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.157484 May 26 17:09:08.945333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 587/1146] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:08 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:09.072498 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0de15a91-8d2a-4bdf-954f-8d3d535deb73 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:09.073040 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0de15a91-8d2a-4bdf-954f-8d3d535deb73 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:09.079536 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0de15a91-8d2a-4bdf-954f-8d3d535deb73 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:09.079986 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0de15a91-8d2a-4bdf-954f-8d3d535deb73 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:09.080754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0de15a91-8d2a-4bdf-954f-8d3d535deb73 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:09.081680 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0de15a91-8d2a-4bdf-954f-8d3d535deb73 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:09.213627 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0de15a91-8d2a-4bdf-954f-8d3d535deb73 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:09.222593 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0de15a91-8d2a-4bdf-954f-8d3d535deb73 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:09.224222 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0de15a91-8d2a-4bdf-954f-8d3d535deb73 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:09.225483 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0de15a91-8d2a-4bdf-954f-8d3d535deb73 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1749 microversion: 2.20 time: 0.157129 May 26 17:09:09.226039 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 560/1147] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:09 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:09.528154 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2aba7578-8677-471a-a2ff-4cd6aecc264c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:09.528763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2aba7578-8677-471a-a2ff-4cd6aecc264c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:09.535281 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2aba7578-8677-471a-a2ff-4cd6aecc264c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:09.535743 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2aba7578-8677-471a-a2ff-4cd6aecc264c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:09.536523 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2aba7578-8677-471a-a2ff-4cd6aecc264c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:09.536957 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2aba7578-8677-471a-a2ff-4cd6aecc264c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:09.682053 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2aba7578-8677-471a-a2ff-4cd6aecc264c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:09.690242 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2aba7578-8677-471a-a2ff-4cd6aecc264c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1370 microversion: 2.1 time: 0.165918 May 26 17:09:09.691602 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 588/1148] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:09 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:09.962523 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-63f54231-b21b-44ee-be81-72470cf9cec6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:09.963357 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-63f54231-b21b-44ee-be81-72470cf9cec6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:09.969570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-63f54231-b21b-44ee-be81-72470cf9cec6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:09.970017 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-63f54231-b21b-44ee-be81-72470cf9cec6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:09.970821 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-63f54231-b21b-44ee-be81-72470cf9cec6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:09.971253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-63f54231-b21b-44ee-be81-72470cf9cec6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:10.114162 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-63f54231-b21b-44ee-be81-72470cf9cec6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:10.121973 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-63f54231-b21b-44ee-be81-72470cf9cec6 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.164270 May 26 17:09:10.122609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 561/1149] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:09 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:10.244873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c5f50ecd-93ca-4d37-a727-297b3e420cd8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:10.245457 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c5f50ecd-93ca-4d37-a727-297b3e420cd8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:10.252602 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5f50ecd-93ca-4d37-a727-297b3e420cd8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:10.253305 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5f50ecd-93ca-4d37-a727-297b3e420cd8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:10.253857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5f50ecd-93ca-4d37-a727-297b3e420cd8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:10.254353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5f50ecd-93ca-4d37-a727-297b3e420cd8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:10.405298 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c5f50ecd-93ca-4d37-a727-297b3e420cd8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:10.414181 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c5f50ecd-93ca-4d37-a727-297b3e420cd8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:10.415711 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c5f50ecd-93ca-4d37-a727-297b3e420cd8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:10.416864 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c5f50ecd-93ca-4d37-a727-297b3e420cd8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1749 microversion: 2.20 time: 0.176002 May 26 17:09:10.417427 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 589/1150] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:10 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:10.708939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cb98e07b-06b1-4d45-b6f8-617221a5a028 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:10.709554 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cb98e07b-06b1-4d45-b6f8-617221a5a028 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:10.715883 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cb98e07b-06b1-4d45-b6f8-617221a5a028 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:10.716330 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cb98e07b-06b1-4d45-b6f8-617221a5a028 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:10.717106 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cb98e07b-06b1-4d45-b6f8-617221a5a028 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:10.717543 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cb98e07b-06b1-4d45-b6f8-617221a5a028 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:10.914976 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cb98e07b-06b1-4d45-b6f8-617221a5a028 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:10.922417 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cb98e07b-06b1-4d45-b6f8-617221a5a028 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1370 microversion: 2.1 time: 0.218193 May 26 17:09:10.922991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 562/1151] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:10 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:11.139521 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-973c05f4-49e9-4dbf-a573-a5adb6a15ad7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:11.140127 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-973c05f4-49e9-4dbf-a573-a5adb6a15ad7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:11.147135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-973c05f4-49e9-4dbf-a573-a5adb6a15ad7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:11.147580 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-973c05f4-49e9-4dbf-a573-a5adb6a15ad7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:11.148349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-973c05f4-49e9-4dbf-a573-a5adb6a15ad7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:11.148775 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-973c05f4-49e9-4dbf-a573-a5adb6a15ad7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:11.296124 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-973c05f4-49e9-4dbf-a573-a5adb6a15ad7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:11.338837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-973c05f4-49e9-4dbf-a573-a5adb6a15ad7 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.168410 May 26 17:09:11.338837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 590/1152] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:11 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:09:11.436243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-835e0273-5907-474d-90d8-5301f9a70f07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:11.437093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-835e0273-5907-474d-90d8-5301f9a70f07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:11.445031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-835e0273-5907-474d-90d8-5301f9a70f07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:11.445590 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-835e0273-5907-474d-90d8-5301f9a70f07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:11.446473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-835e0273-5907-474d-90d8-5301f9a70f07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:11.446967 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-835e0273-5907-474d-90d8-5301f9a70f07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:11.594143 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-835e0273-5907-474d-90d8-5301f9a70f07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:11.603183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-835e0273-5907-474d-90d8-5301f9a70f07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:11.607857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-835e0273-5907-474d-90d8-5301f9a70f07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:11.607857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-835e0273-5907-474d-90d8-5301f9a70f07 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1749 microversion: 2.20 time: 0.174683 May 26 17:09:11.607857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 563/1153] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:11 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:11.678641 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-c28ed333-48d3-48ce-8b24-2e301aded3c0 req-96b734cf-34d2-4d7e-8e93-2aaa6d7ab63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dca66e2-797a-492c-aa32-e2bb881ac25b", "name": "network-vif-plugged", "status": "completed", "tag": "4e63cdc0-f462-4b50-8bc7-40551bf2f0ba"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:09:11.687455 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-c28ed333-48d3-48ce-8b24-2e301aded3c0 req-96b734cf-34d2-4d7e-8e93-2aaa6d7ab63c service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:11.687893 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-c28ed333-48d3-48ce-8b24-2e301aded3c0 req-96b734cf-34d2-4d7e-8e93-2aaa6d7ab63c service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:11.700058 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-c28ed333-48d3-48ce-8b24-2e301aded3c0 req-96b734cf-34d2-4d7e-8e93-2aaa6d7ab63c service nova] Creating event network-vif-plugged:4e63cdc0-f462-4b50-8bc7-40551bf2f0ba for instance 4dca66e2-797a-492c-aa32-e2bb881ac25b on hv-cinder-83607 May 26 17:09:11.705728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-c28ed333-48d3-48ce-8b24-2e301aded3c0 req-96b734cf-34d2-4d7e-8e93-2aaa6d7ab63c service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030984 May 26 17:09:11.706921 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 591/1154] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:09:11.944269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1b0925fe-71c2-4d65-87dc-05bd40ef32c0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:11.944269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1b0925fe-71c2-4d65-87dc-05bd40ef32c0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:11.948067 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1b0925fe-71c2-4d65-87dc-05bd40ef32c0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:11.948515 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1b0925fe-71c2-4d65-87dc-05bd40ef32c0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:11.949329 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1b0925fe-71c2-4d65-87dc-05bd40ef32c0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:11.949770 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1b0925fe-71c2-4d65-87dc-05bd40ef32c0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:12.082571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-1b0925fe-71c2-4d65-87dc-05bd40ef32c0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:12.090117 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1b0925fe-71c2-4d65-87dc-05bd40ef32c0 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1559 microversion: 2.1 time: 0.153361 May 26 17:09:12.090718 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 564/1155] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:11 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:12.107096 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-94693645-a8c4-4518-b429-72c483354223 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:12.107683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-94693645-a8c4-4518-b429-72c483354223 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:12.114493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-94693645-a8c4-4518-b429-72c483354223 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:12.114948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-94693645-a8c4-4518-b429-72c483354223 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:12.115712 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-94693645-a8c4-4518-b429-72c483354223 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:12.116152 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-94693645-a8c4-4518-b429-72c483354223 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:12.196962 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-94693645-a8c4-4518-b429-72c483354223 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094173 May 26 17:09:12.197565 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 592/1156] 10.222.0.112 () {58 vars in 1279 bytes} [Thu May 26 17:09:12 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:09:12.322080 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-69522f52-b49a-4930-a189-c642624abf2e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:12.322720 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-69522f52-b49a-4930-a189-c642624abf2e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:12.328937 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-69522f52-b49a-4930-a189-c642624abf2e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:12.329392 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-69522f52-b49a-4930-a189-c642624abf2e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:12.330144 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-69522f52-b49a-4930-a189-c642624abf2e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:12.330608 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-69522f52-b49a-4930-a189-c642624abf2e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:12.471240 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-69522f52-b49a-4930-a189-c642624abf2e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:12.479334 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-69522f52-b49a-4930-a189-c642624abf2e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.161179 May 26 17:09:12.479905 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 565/1157] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:12 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:12.626673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-12407cc2-5606-482c-bc43-4c7f666fef15 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:12.627310 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-12407cc2-5606-482c-bc43-4c7f666fef15 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:12.634331 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12407cc2-5606-482c-bc43-4c7f666fef15 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:12.634787 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12407cc2-5606-482c-bc43-4c7f666fef15 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:12.635552 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12407cc2-5606-482c-bc43-4c7f666fef15 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:12.636024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-12407cc2-5606-482c-bc43-4c7f666fef15 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:12.779349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-12407cc2-5606-482c-bc43-4c7f666fef15 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:12.788074 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-12407cc2-5606-482c-bc43-4c7f666fef15 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:12.789576 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-12407cc2-5606-482c-bc43-4c7f666fef15 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:12.790803 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-12407cc2-5606-482c-bc43-4c7f666fef15 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1749 microversion: 2.20 time: 0.168829 May 26 17:09:12.791370 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 593/1158] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:12 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:13.457298 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-7f15a583-90b8-4170-8f1d-2eec36bd39ea req-e5c6993f-297c-491c-9942-edbf31d6cac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c01d7d7-3fc2-4327-b3e7-f8415b2d323f", "tag": "9dcd846e-cfa0-472b-9e6d-3b7b0aa8c2c9"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:09:13.466489 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-7f15a583-90b8-4170-8f1d-2eec36bd39ea req-e5c6993f-297c-491c-9942-edbf31d6cac2 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:13.466937 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-7f15a583-90b8-4170-8f1d-2eec36bd39ea req-e5c6993f-297c-491c-9942-edbf31d6cac2 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:13.479147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-7f15a583-90b8-4170-8f1d-2eec36bd39ea req-e5c6993f-297c-491c-9942-edbf31d6cac2 service nova] Creating event network-changed:9dcd846e-cfa0-472b-9e6d-3b7b0aa8c2c9 for instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f on hv-cinder-83607 May 26 17:09:13.484085 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-7f15a583-90b8-4170-8f1d-2eec36bd39ea req-e5c6993f-297c-491c-9942-edbf31d6cac2 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030512 May 26 17:09:13.484729 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 566/1159] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:09:13.497631 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7fdfb503-21d2-4730-80f1-41dc6a990192 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:13.498238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7fdfb503-21d2-4730-80f1-41dc6a990192 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:13.512609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7fdfb503-21d2-4730-80f1-41dc6a990192 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:13.513147 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7fdfb503-21d2-4730-80f1-41dc6a990192 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:13.513995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7fdfb503-21d2-4730-80f1-41dc6a990192 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:13.514539 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7fdfb503-21d2-4730-80f1-41dc6a990192 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:13.648828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7fdfb503-21d2-4730-80f1-41dc6a990192 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:13.656454 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7fdfb503-21d2-4730-80f1-41dc6a990192 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.162657 May 26 17:09:13.657038 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 594/1160] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:13 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:13.809571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-547c1809-a931-43de-bf74-19035b8680be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:13.810341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-547c1809-a931-43de-bf74-19035b8680be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:13.816781 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-547c1809-a931-43de-bf74-19035b8680be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:13.817234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-547c1809-a931-43de-bf74-19035b8680be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:13.818018 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-547c1809-a931-43de-bf74-19035b8680be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:13.818489 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-547c1809-a931-43de-bf74-19035b8680be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:13.959190 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-547c1809-a931-43de-bf74-19035b8680be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:13.967371 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-547c1809-a931-43de-bf74-19035b8680be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:13.968880 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-547c1809-a931-43de-bf74-19035b8680be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:13.978440 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-547c1809-a931-43de-bf74-19035b8680be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1749 microversion: 2.20 time: 0.164784 May 26 17:09:13.978440 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 567/1161] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:13 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:14.673377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-01a7e572-56b4-45be-b5ae-e9ef2b1aef58 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:14.675086 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-01a7e572-56b4-45be-b5ae-e9ef2b1aef58 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:14.680785 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-01a7e572-56b4-45be-b5ae-e9ef2b1aef58 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:14.681225 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-01a7e572-56b4-45be-b5ae-e9ef2b1aef58 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:14.681980 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-01a7e572-56b4-45be-b5ae-e9ef2b1aef58 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:14.682433 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-01a7e572-56b4-45be-b5ae-e9ef2b1aef58 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:14.815406 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-01a7e572-56b4-45be-b5ae-e9ef2b1aef58 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:14.822971 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-01a7e572-56b4-45be-b5ae-e9ef2b1aef58 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.153490 May 26 17:09:14.823687 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 595/1162] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:14 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:14.989287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-96440bce-ffaf-49da-b260-28adb4e6dfd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:14.989905 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-96440bce-ffaf-49da-b260-28adb4e6dfd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:14.996635 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-96440bce-ffaf-49da-b260-28adb4e6dfd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:14.997086 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-96440bce-ffaf-49da-b260-28adb4e6dfd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:14.997856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-96440bce-ffaf-49da-b260-28adb4e6dfd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:14.998295 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-96440bce-ffaf-49da-b260-28adb4e6dfd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:15.126449 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-96440bce-ffaf-49da-b260-28adb4e6dfd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:15.134886 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-96440bce-ffaf-49da-b260-28adb4e6dfd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:15.136402 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-96440bce-ffaf-49da-b260-28adb4e6dfd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:15.137574 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-96440bce-ffaf-49da-b260-28adb4e6dfd4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1749 microversion: 2.20 time: 0.152470 May 26 17:09:15.138148 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 568/1163] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:14 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:15.840024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-02be632a-87b9-4708-be05-da07d748ef05 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:15.840636 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-02be632a-87b9-4708-be05-da07d748ef05 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:15.847956 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02be632a-87b9-4708-be05-da07d748ef05 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:15.850707 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02be632a-87b9-4708-be05-da07d748ef05 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:15.850707 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02be632a-87b9-4708-be05-da07d748ef05 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:15.850707 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-02be632a-87b9-4708-be05-da07d748ef05 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:15.979591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-02be632a-87b9-4708-be05-da07d748ef05 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:15.987224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-02be632a-87b9-4708-be05-da07d748ef05 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.151000 May 26 17:09:15.988685 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 596/1164] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:15 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:16.156463 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-77f8a8a7-66a9-4fbc-bc42-faed9ac18112 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:16.157105 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-77f8a8a7-66a9-4fbc-bc42-faed9ac18112 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:16.164814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-77f8a8a7-66a9-4fbc-bc42-faed9ac18112 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:16.165263 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-77f8a8a7-66a9-4fbc-bc42-faed9ac18112 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:16.166022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-77f8a8a7-66a9-4fbc-bc42-faed9ac18112 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:16.166489 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-77f8a8a7-66a9-4fbc-bc42-faed9ac18112 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:16.299343 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-77f8a8a7-66a9-4fbc-bc42-faed9ac18112 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:16.307269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-77f8a8a7-66a9-4fbc-bc42-faed9ac18112 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:16.308873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-77f8a8a7-66a9-4fbc-bc42-faed9ac18112 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:16.310078 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-77f8a8a7-66a9-4fbc-bc42-faed9ac18112 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1749 microversion: 2.20 time: 0.157481 May 26 17:09:16.310674 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 569/1165] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:16 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:17.005518 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1e32dda2-3dd1-431e-9c1f-ab1bcb9803aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:17.006133 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1e32dda2-3dd1-431e-9c1f-ab1bcb9803aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:17.012619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1e32dda2-3dd1-431e-9c1f-ab1bcb9803aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:17.013070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1e32dda2-3dd1-431e-9c1f-ab1bcb9803aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:17.013825 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1e32dda2-3dd1-431e-9c1f-ab1bcb9803aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:17.014258 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1e32dda2-3dd1-431e-9c1f-ab1bcb9803aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:17.151920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1e32dda2-3dd1-431e-9c1f-ab1bcb9803aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:17.160555 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1e32dda2-3dd1-431e-9c1f-ab1bcb9803aa tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.158618 May 26 17:09:17.166632 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 597/1166] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:16 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:17.329681 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a9208924-eeda-4658-9cab-db32c97df3dc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:17.330341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a9208924-eeda-4658-9cab-db32c97df3dc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:17.337555 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a9208924-eeda-4658-9cab-db32c97df3dc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:17.340364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a9208924-eeda-4658-9cab-db32c97df3dc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:17.340364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a9208924-eeda-4658-9cab-db32c97df3dc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:17.340364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a9208924-eeda-4658-9cab-db32c97df3dc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:17.479136 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a9208924-eeda-4658-9cab-db32c97df3dc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:17.487230 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a9208924-eeda-4658-9cab-db32c97df3dc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:17.488923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a9208924-eeda-4658-9cab-db32c97df3dc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:17.490252 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a9208924-eeda-4658-9cab-db32c97df3dc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.165568 May 26 17:09:17.490926 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 570/1167] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:17 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:18.177766 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ec45d37c-1666-4892-8cbe-32f540e92390 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:18.178411 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ec45d37c-1666-4892-8cbe-32f540e92390 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:18.184960 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec45d37c-1666-4892-8cbe-32f540e92390 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:18.185405 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec45d37c-1666-4892-8cbe-32f540e92390 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:18.186164 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec45d37c-1666-4892-8cbe-32f540e92390 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:18.186622 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ec45d37c-1666-4892-8cbe-32f540e92390 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:18.326559 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ec45d37c-1666-4892-8cbe-32f540e92390 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:18.335976 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ec45d37c-1666-4892-8cbe-32f540e92390 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.162627 May 26 17:09:18.336561 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 598/1168] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:18 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:18.509865 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-36d59926-fb2f-4dff-b2ec-5db5ebd37fb2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:18.514279 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-36d59926-fb2f-4dff-b2ec-5db5ebd37fb2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:18.526876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-36d59926-fb2f-4dff-b2ec-5db5ebd37fb2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:18.527338 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-36d59926-fb2f-4dff-b2ec-5db5ebd37fb2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:18.528123 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-36d59926-fb2f-4dff-b2ec-5db5ebd37fb2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:18.531122 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-36d59926-fb2f-4dff-b2ec-5db5ebd37fb2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:18.694978 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-36d59926-fb2f-4dff-b2ec-5db5ebd37fb2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:18.704922 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-36d59926-fb2f-4dff-b2ec-5db5ebd37fb2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:18.707856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-36d59926-fb2f-4dff-b2ec-5db5ebd37fb2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:18.709129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-36d59926-fb2f-4dff-b2ec-5db5ebd37fb2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.203883 May 26 17:09:18.710455 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 571/1169] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:18 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:19.352995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9e249eb3-3468-49bd-90f4-3ed8f7f65f38 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:19.353718 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9e249eb3-3468-49bd-90f4-3ed8f7f65f38 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:19.360462 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9e249eb3-3468-49bd-90f4-3ed8f7f65f38 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:19.360920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9e249eb3-3468-49bd-90f4-3ed8f7f65f38 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:19.361696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9e249eb3-3468-49bd-90f4-3ed8f7f65f38 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:19.362688 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9e249eb3-3468-49bd-90f4-3ed8f7f65f38 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:19.502724 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9e249eb3-3468-49bd-90f4-3ed8f7f65f38 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:19.511247 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9e249eb3-3468-49bd-90f4-3ed8f7f65f38 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.162149 May 26 17:09:19.511894 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 599/1170] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:19 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:19.729162 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4f4f418d-47da-436a-939a-e148b05e5470 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:19.729887 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4f4f418d-47da-436a-939a-e148b05e5470 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:19.736753 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4f4f418d-47da-436a-939a-e148b05e5470 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:19.738483 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4f4f418d-47da-436a-939a-e148b05e5470 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:19.739513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4f4f418d-47da-436a-939a-e148b05e5470 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:19.740173 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4f4f418d-47da-436a-939a-e148b05e5470 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:19.889204 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4f4f418d-47da-436a-939a-e148b05e5470 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:19.899649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4f4f418d-47da-436a-939a-e148b05e5470 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:19.901181 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4f4f418d-47da-436a-939a-e148b05e5470 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:19.902397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4f4f418d-47da-436a-939a-e148b05e5470 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.177253 May 26 17:09:19.903289 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 572/1171] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:19 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:20.528575 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b869a65f-5d99-460a-9b5a-602653008299 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:20.529408 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b869a65f-5d99-460a-9b5a-602653008299 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:20.541966 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b869a65f-5d99-460a-9b5a-602653008299 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:20.542460 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b869a65f-5d99-460a-9b5a-602653008299 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:20.543242 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b869a65f-5d99-460a-9b5a-602653008299 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:20.543682 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b869a65f-5d99-460a-9b5a-602653008299 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:20.694905 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b869a65f-5d99-460a-9b5a-602653008299 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:20.712167 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b869a65f-5d99-460a-9b5a-602653008299 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.186573 May 26 17:09:20.714795 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 600/1172] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:20 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:20.922159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-251419d9-ac6a-4e55-b4b9-24099f9c2a94 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:20.924301 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-251419d9-ac6a-4e55-b4b9-24099f9c2a94 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:20.932279 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-251419d9-ac6a-4e55-b4b9-24099f9c2a94 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:20.933027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-251419d9-ac6a-4e55-b4b9-24099f9c2a94 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:20.933837 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-251419d9-ac6a-4e55-b4b9-24099f9c2a94 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:20.934271 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-251419d9-ac6a-4e55-b4b9-24099f9c2a94 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:21.086134 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-251419d9-ac6a-4e55-b4b9-24099f9c2a94 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:21.096011 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-251419d9-ac6a-4e55-b4b9-24099f9c2a94 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:21.098694 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-251419d9-ac6a-4e55-b4b9-24099f9c2a94 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:21.100306 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-251419d9-ac6a-4e55-b4b9-24099f9c2a94 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.182744 May 26 17:09:21.101198 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 573/1173] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:20 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:21.730090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-04de3478-7bdf-4471-9f9d-923edaae95ce tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:21.730975 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-04de3478-7bdf-4471-9f9d-923edaae95ce tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:21.737684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-04de3478-7bdf-4471-9f9d-923edaae95ce tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:21.738425 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-04de3478-7bdf-4471-9f9d-923edaae95ce tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:21.739414 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-04de3478-7bdf-4471-9f9d-923edaae95ce tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:21.739852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-04de3478-7bdf-4471-9f9d-923edaae95ce tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:21.886203 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-04de3478-7bdf-4471-9f9d-923edaae95ce tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:21.896606 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-04de3478-7bdf-4471-9f9d-923edaae95ce tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.170288 May 26 17:09:21.897211 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 601/1174] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:21 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:22.119330 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-abded106-6928-4ad6-8839-2d17828b3b28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:22.119893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-abded106-6928-4ad6-8839-2d17828b3b28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:22.126878 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-abded106-6928-4ad6-8839-2d17828b3b28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:22.127331 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-abded106-6928-4ad6-8839-2d17828b3b28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:22.128727 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-abded106-6928-4ad6-8839-2d17828b3b28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:22.129166 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-abded106-6928-4ad6-8839-2d17828b3b28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:22.272893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-abded106-6928-4ad6-8839-2d17828b3b28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:22.282641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-abded106-6928-4ad6-8839-2d17828b3b28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:22.284198 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-abded106-6928-4ad6-8839-2d17828b3b28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:22.285357 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-abded106-6928-4ad6-8839-2d17828b3b28 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.170127 May 26 17:09:22.285923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 574/1175] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:22 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:22.915326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-009481f0-73e7-49e4-b285-132b09c30b2d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:22.916024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-009481f0-73e7-49e4-b285-132b09c30b2d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:22.922812 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-009481f0-73e7-49e4-b285-132b09c30b2d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:22.923497 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-009481f0-73e7-49e4-b285-132b09c30b2d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:22.924278 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-009481f0-73e7-49e4-b285-132b09c30b2d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:22.924719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-009481f0-73e7-49e4-b285-132b09c30b2d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:23.067021 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-009481f0-73e7-49e4-b285-132b09c30b2d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:23.074857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-009481f0-73e7-49e4-b285-132b09c30b2d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.163553 May 26 17:09:23.075952 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 602/1176] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:22 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:23.303823 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f087bc8e-1bce-4ba6-a7d5-07de2f83f6c6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:23.304373 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f087bc8e-1bce-4ba6-a7d5-07de2f83f6c6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:23.310877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f087bc8e-1bce-4ba6-a7d5-07de2f83f6c6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:23.311327 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f087bc8e-1bce-4ba6-a7d5-07de2f83f6c6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:23.312114 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f087bc8e-1bce-4ba6-a7d5-07de2f83f6c6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:23.312576 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f087bc8e-1bce-4ba6-a7d5-07de2f83f6c6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:23.332715 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:23.458225 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f087bc8e-1bce-4ba6-a7d5-07de2f83f6c6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:23.466090 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f087bc8e-1bce-4ba6-a7d5-07de2f83f6c6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:23.467638 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f087bc8e-1bce-4ba6-a7d5-07de2f83f6c6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:23.468798 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f087bc8e-1bce-4ba6-a7d5-07de2f83f6c6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.169233 May 26 17:09:23.469373 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 575/1177] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:23 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:24.094289 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e76c9501-9a59-44f5-93c8-12cdcd1af57c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:24.095240 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e76c9501-9a59-44f5-93c8-12cdcd1af57c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:24.103497 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e76c9501-9a59-44f5-93c8-12cdcd1af57c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:24.104383 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e76c9501-9a59-44f5-93c8-12cdcd1af57c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:24.105391 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e76c9501-9a59-44f5-93c8-12cdcd1af57c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:24.105998 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e76c9501-9a59-44f5-93c8-12cdcd1af57c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:24.243127 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e76c9501-9a59-44f5-93c8-12cdcd1af57c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:24.250725 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e76c9501-9a59-44f5-93c8-12cdcd1af57c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.160429 May 26 17:09:24.251299 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 603/1178] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:24 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:24.491010 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-51a25005-48f9-4342-a64b-4f9ef3209f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:24.492983 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-51a25005-48f9-4342-a64b-4f9ef3209f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:24.499821 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-51a25005-48f9-4342-a64b-4f9ef3209f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:24.500482 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-51a25005-48f9-4342-a64b-4f9ef3209f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:24.502244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-51a25005-48f9-4342-a64b-4f9ef3209f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:24.502828 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-51a25005-48f9-4342-a64b-4f9ef3209f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:24.675964 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-51a25005-48f9-4342-a64b-4f9ef3209f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:24.684511 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-51a25005-48f9-4342-a64b-4f9ef3209f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:24.686487 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-51a25005-48f9-4342-a64b-4f9ef3209f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:24.687931 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-51a25005-48f9-4342-a64b-4f9ef3209f8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.204058 May 26 17:09:24.699497 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 576/1179] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:24 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:09:25.268149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-665369fe-415b-4aed-b884-64f2bdd653c4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:25.270696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-665369fe-415b-4aed-b884-64f2bdd653c4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:25.278342 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-665369fe-415b-4aed-b884-64f2bdd653c4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:25.278908 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-665369fe-415b-4aed-b884-64f2bdd653c4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:25.279799 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-665369fe-415b-4aed-b884-64f2bdd653c4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:25.280477 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-665369fe-415b-4aed-b884-64f2bdd653c4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:25.285908 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=100 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:25.423321 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-665369fe-415b-4aed-b884-64f2bdd653c4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:25.431247 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-665369fe-415b-4aed-b884-64f2bdd653c4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.167165 May 26 17:09:25.431930 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 604/1180] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:25 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:25.707968 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-061a04fc-abdd-41d9-8051-61ec757557d2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:25.708533 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-061a04fc-abdd-41d9-8051-61ec757557d2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:25.714982 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-061a04fc-abdd-41d9-8051-61ec757557d2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:25.715430 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-061a04fc-abdd-41d9-8051-61ec757557d2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:25.716192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-061a04fc-abdd-41d9-8051-61ec757557d2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:25.716627 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-061a04fc-abdd-41d9-8051-61ec757557d2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:25.854344 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-061a04fc-abdd-41d9-8051-61ec757557d2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:25.862738 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-061a04fc-abdd-41d9-8051-61ec757557d2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:25.864218 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-061a04fc-abdd-41d9-8051-61ec757557d2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:25.865364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-061a04fc-abdd-41d9-8051-61ec757557d2 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.162330 May 26 17:09:25.865919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 577/1181] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:25 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:26.448992 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4b1bd234-5ae2-4a69-bf7f-2ed4977e0e39 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:26.449619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4b1bd234-5ae2-4a69-bf7f-2ed4977e0e39 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:26.456970 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4b1bd234-5ae2-4a69-bf7f-2ed4977e0e39 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:26.457371 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4b1bd234-5ae2-4a69-bf7f-2ed4977e0e39 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:26.458237 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4b1bd234-5ae2-4a69-bf7f-2ed4977e0e39 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:26.458738 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4b1bd234-5ae2-4a69-bf7f-2ed4977e0e39 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:26.643149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4b1bd234-5ae2-4a69-bf7f-2ed4977e0e39 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:26.651269 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4b1bd234-5ae2-4a69-bf7f-2ed4977e0e39 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.206239 May 26 17:09:26.651844 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 605/1182] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:26 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:26.883998 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-552849d1-001d-404a-9cc6-3f1d0c78c6f6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:26.885468 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-552849d1-001d-404a-9cc6-3f1d0c78c6f6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:26.891510 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-552849d1-001d-404a-9cc6-3f1d0c78c6f6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:26.891949 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-552849d1-001d-404a-9cc6-3f1d0c78c6f6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:26.892726 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-552849d1-001d-404a-9cc6-3f1d0c78c6f6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:26.893167 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-552849d1-001d-404a-9cc6-3f1d0c78c6f6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:27.096692 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-552849d1-001d-404a-9cc6-3f1d0c78c6f6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:27.108302 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-552849d1-001d-404a-9cc6-3f1d0c78c6f6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:27.110707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-552849d1-001d-404a-9cc6-3f1d0c78c6f6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:27.113104 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-552849d1-001d-404a-9cc6-3f1d0c78c6f6 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.233004 May 26 17:09:27.113953 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 578/1183] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:26 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:27.334059 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-e425185c-8d6b-4276-94a5-641fb408ba89 req-a34025f2-2f71-46a9-accd-e398c20c7ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674dca1d-7dd2-42f4-8ddc-f9742a6d688d", "name": "network-vif-plugged", "status": "completed", "tag": "0ca04129-6455-4066-a7dd-a0f93617531c"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:09:27.358511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-e425185c-8d6b-4276-94a5-641fb408ba89 req-a34025f2-2f71-46a9-accd-e398c20c7ce6 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:27.359231 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-e425185c-8d6b-4276-94a5-641fb408ba89 req-a34025f2-2f71-46a9-accd-e398c20c7ce6 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:27.372135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-e425185c-8d6b-4276-94a5-641fb408ba89 req-a34025f2-2f71-46a9-accd-e398c20c7ce6 service nova] Creating event network-vif-plugged:0ca04129-6455-4066-a7dd-a0f93617531c for instance 674dca1d-7dd2-42f4-8ddc-f9742a6d688d on hv-cinder-83607 May 26 17:09:27.377801 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-e425185c-8d6b-4276-94a5-641fb408ba89 req-a34025f2-2f71-46a9-accd-e398c20c7ce6 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054465 May 26 17:09:27.380791 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 606/1184] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:09:27.671180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-39ef6c1f-a8f8-4452-998a-3e275fb8ac65 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:27.673193 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-39ef6c1f-a8f8-4452-998a-3e275fb8ac65 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:27.682647 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-39ef6c1f-a8f8-4452-998a-3e275fb8ac65 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:27.683087 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-39ef6c1f-a8f8-4452-998a-3e275fb8ac65 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:27.684552 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-39ef6c1f-a8f8-4452-998a-3e275fb8ac65 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:27.685183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-39ef6c1f-a8f8-4452-998a-3e275fb8ac65 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:27.870079 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-39ef6c1f-a8f8-4452-998a-3e275fb8ac65 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:27.878634 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-39ef6c1f-a8f8-4452-998a-3e275fb8ac65 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.211746 May 26 17:09:27.887844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 579/1185] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:27 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:28.133898 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-284c73cf-a944-41db-85f0-0ba8aef1ccce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:28.134850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-284c73cf-a944-41db-85f0-0ba8aef1ccce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:28.143282 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-284c73cf-a944-41db-85f0-0ba8aef1ccce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:28.149513 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-284c73cf-a944-41db-85f0-0ba8aef1ccce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:28.149513 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-284c73cf-a944-41db-85f0-0ba8aef1ccce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:28.149513 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-284c73cf-a944-41db-85f0-0ba8aef1ccce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:28.302230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-284c73cf-a944-41db-85f0-0ba8aef1ccce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:28.312647 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-284c73cf-a944-41db-85f0-0ba8aef1ccce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:28.314511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-284c73cf-a944-41db-85f0-0ba8aef1ccce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:28.316177 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-284c73cf-a944-41db-85f0-0ba8aef1ccce tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.186527 May 26 17:09:28.317511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 607/1186] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:28 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:28.896167 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a1d790c5-ebad-44cc-9852-52692dc27a81 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:28.897093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a1d790c5-ebad-44cc-9852-52692dc27a81 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:28.907129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a1d790c5-ebad-44cc-9852-52692dc27a81 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:28.908052 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a1d790c5-ebad-44cc-9852-52692dc27a81 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:28.910219 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a1d790c5-ebad-44cc-9852-52692dc27a81 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:28.910689 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a1d790c5-ebad-44cc-9852-52692dc27a81 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:29.064439 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a1d790c5-ebad-44cc-9852-52692dc27a81 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:29.074707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a1d790c5-ebad-44cc-9852-52692dc27a81 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.182930 May 26 17:09:29.075526 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 580/1187] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:28 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:29.337990 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-fde899b0-8e33-4c57-bd34-efa93da2d157 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:29.338726 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-fde899b0-8e33-4c57-bd34-efa93da2d157 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:29.341466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=74 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:29.347087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fde899b0-8e33-4c57-bd34-efa93da2d157 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:29.347550 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fde899b0-8e33-4c57-bd34-efa93da2d157 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:29.348333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fde899b0-8e33-4c57-bd34-efa93da2d157 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:29.348776 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fde899b0-8e33-4c57-bd34-efa93da2d157 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:29.509670 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fde899b0-8e33-4c57-bd34-efa93da2d157 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:29.518181 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fde899b0-8e33-4c57-bd34-efa93da2d157 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:29.520617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fde899b0-8e33-4c57-bd34-efa93da2d157 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:29.521802 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-fde899b0-8e33-4c57-bd34-efa93da2d157 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.189073 May 26 17:09:29.522384 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 608/1188] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:29 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:30.093133 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-731d97f6-3f08-4279-8d92-b92e31863e3d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:30.093919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-731d97f6-3f08-4279-8d92-b92e31863e3d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:30.101139 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-731d97f6-3f08-4279-8d92-b92e31863e3d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:30.101770 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-731d97f6-3f08-4279-8d92-b92e31863e3d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:30.102711 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-731d97f6-3f08-4279-8d92-b92e31863e3d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:30.103566 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-731d97f6-3f08-4279-8d92-b92e31863e3d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:30.267847 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-731d97f6-3f08-4279-8d92-b92e31863e3d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:30.278893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-731d97f6-3f08-4279-8d92-b92e31863e3d tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1270 microversion: 2.1 time: 0.189460 May 26 17:09:30.280038 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 581/1189] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:30 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1270 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:30.542486 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8f767bc6-1859-4fb7-a409-162d31ad52e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:30.543160 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8f767bc6-1859-4fb7-a409-162d31ad52e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:30.551008 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8f767bc6-1859-4fb7-a409-162d31ad52e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:30.551521 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8f767bc6-1859-4fb7-a409-162d31ad52e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:30.552349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8f767bc6-1859-4fb7-a409-162d31ad52e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:30.552806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8f767bc6-1859-4fb7-a409-162d31ad52e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:30.687126 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8f767bc6-1859-4fb7-a409-162d31ad52e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:30.695449 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8f767bc6-1859-4fb7-a409-162d31ad52e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:30.696943 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8f767bc6-1859-4fb7-a409-162d31ad52e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:30.698097 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8f767bc6-1859-4fb7-a409-162d31ad52e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.159883 May 26 17:09:30.698685 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 609/1190] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:30 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:09:31.296673 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a876cbee-79bf-49c5-b998-9d74fc94ff79 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:31.297291 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a876cbee-79bf-49c5-b998-9d74fc94ff79 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:31.304303 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a876cbee-79bf-49c5-b998-9d74fc94ff79 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:31.304750 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a876cbee-79bf-49c5-b998-9d74fc94ff79 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:31.305510 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a876cbee-79bf-49c5-b998-9d74fc94ff79 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:31.305947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a876cbee-79bf-49c5-b998-9d74fc94ff79 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:31.436697 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a876cbee-79bf-49c5-b998-9d74fc94ff79 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:31.444317 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a876cbee-79bf-49c5-b998-9d74fc94ff79 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1456 microversion: 2.1 time: 0.151509 May 26 17:09:31.444892 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 582/1191] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:31 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1456 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:09:31.460625 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-fe1d2c48-93f6-4b8a-a714-94a06b0e125e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:31.461171 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-fe1d2c48-93f6-4b8a-a714-94a06b0e125e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:31.467265 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fe1d2c48-93f6-4b8a-a714-94a06b0e125e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:31.467721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fe1d2c48-93f6-4b8a-a714-94a06b0e125e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:31.468481 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fe1d2c48-93f6-4b8a-a714-94a06b0e125e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:31.468919 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fe1d2c48-93f6-4b8a-a714-94a06b0e125e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:31.603154 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fe1d2c48-93f6-4b8a-a714-94a06b0e125e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:31.610592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-fe1d2c48-93f6-4b8a-a714-94a06b0e125e tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1456 microversion: 2.1 time: 0.153825 May 26 17:09:31.611152 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 610/1192] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:09:31 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1456 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:09:31.716952 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cdfc5f32-f8e8-42e3-82ec-85f670e7cd7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:31.717488 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cdfc5f32-f8e8-42e3-82ec-85f670e7cd7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:31.724105 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cdfc5f32-f8e8-42e3-82ec-85f670e7cd7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:31.724551 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cdfc5f32-f8e8-42e3-82ec-85f670e7cd7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:31.725312 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cdfc5f32-f8e8-42e3-82ec-85f670e7cd7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:31.725745 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cdfc5f32-f8e8-42e3-82ec-85f670e7cd7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:31.858638 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cdfc5f32-f8e8-42e3-82ec-85f670e7cd7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:31.867443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cdfc5f32-f8e8-42e3-82ec-85f670e7cd7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:31.868988 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cdfc5f32-f8e8-42e3-82ec-85f670e7cd7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:31.870260 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cdfc5f32-f8e8-42e3-82ec-85f670e7cd7b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1744 microversion: 2.20 time: 0.157170 May 26 17:09:31.870870 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 583/1193] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:31 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:32.888585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3e5b60dd-52f2-41be-ba3b-4b684d295034 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:32.890095 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3e5b60dd-52f2-41be-ba3b-4b684d295034 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:32.896480 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3e5b60dd-52f2-41be-ba3b-4b684d295034 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:32.896936 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3e5b60dd-52f2-41be-ba3b-4b684d295034 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:32.897711 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3e5b60dd-52f2-41be-ba3b-4b684d295034 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:32.898222 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3e5b60dd-52f2-41be-ba3b-4b684d295034 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:33.120338 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3e5b60dd-52f2-41be-ba3b-4b684d295034 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:33.128592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3e5b60dd-52f2-41be-ba3b-4b684d295034 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:33.130117 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3e5b60dd-52f2-41be-ba3b-4b684d295034 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:33.131313 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3e5b60dd-52f2-41be-ba3b-4b684d295034 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1726 microversion: 2.20 time: 0.246698 May 26 17:09:33.132070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 611/1194] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:32 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1726 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:33.845025 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-23ed1978-d530-4913-9ccd-2eabf78a81a0 req-22000cc7-1aa6-435a-9867-7417819bb6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674dca1d-7dd2-42f4-8ddc-f9742a6d688d", "tag": "0ca04129-6455-4066-a7dd-a0f93617531c"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:09:33.853878 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-23ed1978-d530-4913-9ccd-2eabf78a81a0 req-22000cc7-1aa6-435a-9867-7417819bb6bd service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:33.854449 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-23ed1978-d530-4913-9ccd-2eabf78a81a0 req-22000cc7-1aa6-435a-9867-7417819bb6bd service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:33.865865 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-23ed1978-d530-4913-9ccd-2eabf78a81a0 req-22000cc7-1aa6-435a-9867-7417819bb6bd service nova] Creating event network-changed:0ca04129-6455-4066-a7dd-a0f93617531c for instance 674dca1d-7dd2-42f4-8ddc-f9742a6d688d on hv-cinder-83607 May 26 17:09:33.871105 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-23ed1978-d530-4913-9ccd-2eabf78a81a0 req-22000cc7-1aa6-435a-9867-7417819bb6bd service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029725 May 26 17:09:33.871713 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 584/1195] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:09:34.149934 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c39a3792-4d8e-4aeb-8063-8f812b36e53a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:34.150587 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c39a3792-4d8e-4aeb-8063-8f812b36e53a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:34.157402 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c39a3792-4d8e-4aeb-8063-8f812b36e53a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:34.157854 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c39a3792-4d8e-4aeb-8063-8f812b36e53a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:34.158665 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c39a3792-4d8e-4aeb-8063-8f812b36e53a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:34.159141 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c39a3792-4d8e-4aeb-8063-8f812b36e53a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:34.291253 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c39a3792-4d8e-4aeb-8063-8f812b36e53a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:34.299285 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c39a3792-4d8e-4aeb-8063-8f812b36e53a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:34.301696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c39a3792-4d8e-4aeb-8063-8f812b36e53a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:34.302914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c39a3792-4d8e-4aeb-8063-8f812b36e53a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1726 microversion: 2.20 time: 0.157020 May 26 17:09:34.303485 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 612/1196] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:34 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:09:35.296791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-df37f484-9524-4e4d-8c04-ed241ed8ea09 req-17be4f4b-7cb5-4f5e-b63e-fd211ce4743c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dca66e2-797a-492c-aa32-e2bb881ac25b", "name": "network-vif-unplugged", "status": "completed", "tag": "4e63cdc0-f462-4b50-8bc7-40551bf2f0ba"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:09:35.306534 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-df37f484-9524-4e4d-8c04-ed241ed8ea09 req-17be4f4b-7cb5-4f5e-b63e-fd211ce4743c service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:35.307072 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-df37f484-9524-4e4d-8c04-ed241ed8ea09 req-17be4f4b-7cb5-4f5e-b63e-fd211ce4743c service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:35.318691 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-df37f484-9524-4e4d-8c04-ed241ed8ea09 req-17be4f4b-7cb5-4f5e-b63e-fd211ce4743c service nova] Creating event network-vif-unplugged:4e63cdc0-f462-4b50-8bc7-40551bf2f0ba for instance 4dca66e2-797a-492c-aa32-e2bb881ac25b on hv-cinder-83607 May 26 17:09:35.321426 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9b8209c6-99a5-4dad-9d63-78f375aec3ed tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:35.322841 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9b8209c6-99a5-4dad-9d63-78f375aec3ed tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:35.323425 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-df37f484-9524-4e4d-8c04-ed241ed8ea09 req-17be4f4b-7cb5-4f5e-b63e-fd211ce4743c service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162688 May 26 17:09:35.324024 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 585/1197] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:09:35.329694 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9b8209c6-99a5-4dad-9d63-78f375aec3ed tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:35.330146 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9b8209c6-99a5-4dad-9d63-78f375aec3ed tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:35.331010 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9b8209c6-99a5-4dad-9d63-78f375aec3ed tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:35.332057 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9b8209c6-99a5-4dad-9d63-78f375aec3ed tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:35.466288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9b8209c6-99a5-4dad-9d63-78f375aec3ed tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:35.474968 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9b8209c6-99a5-4dad-9d63-78f375aec3ed tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:35.476450 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9b8209c6-99a5-4dad-9d63-78f375aec3ed tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:35.477605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9b8209c6-99a5-4dad-9d63-78f375aec3ed tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1726 microversion: 2.20 time: 0.160554 May 26 17:09:35.478158 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 613/1198] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:35 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:09:36.497825 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6b1363d4-60fe-4e8f-b8ed-698805c44060 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:36.498477 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6b1363d4-60fe-4e8f-b8ed-698805c44060 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:36.505891 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6b1363d4-60fe-4e8f-b8ed-698805c44060 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:36.506357 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6b1363d4-60fe-4e8f-b8ed-698805c44060 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:36.507131 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6b1363d4-60fe-4e8f-b8ed-698805c44060 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:36.507567 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6b1363d4-60fe-4e8f-b8ed-698805c44060 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:36.645365 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6b1363d4-60fe-4e8f-b8ed-698805c44060 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:36.653329 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6b1363d4-60fe-4e8f-b8ed-698805c44060 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:36.654856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6b1363d4-60fe-4e8f-b8ed-698805c44060 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:36.656007 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6b1363d4-60fe-4e8f-b8ed-698805c44060 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1729 microversion: 2.20 time: 0.163280 May 26 17:09:36.656560 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 586/1199] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:36 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:36.679955 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7e117a20-effb-4fbf-9c95-ba00163a3fc1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61980537-777a-4a9f-a567-3d0435c1393e"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:09:36.681033 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7e117a20-effb-4fbf-9c95-ba00163a3fc1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:36.687696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7e117a20-effb-4fbf-9c95-ba00163a3fc1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:36.688152 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7e117a20-effb-4fbf-9c95-ba00163a3fc1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:36.688926 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7e117a20-effb-4fbf-9c95-ba00163a3fc1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:36.689367 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7e117a20-effb-4fbf-9c95-ba00163a3fc1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:37.802139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7e117a20-effb-4fbf-9c95-ba00163a3fc1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "POST /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.126118 May 26 17:09:37.802823 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 614/1200] 10.222.0.112 () {62 vars in 1368 bytes} [Thu May 26 17:09:36 2022] POST /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/os-volume_attachments => generated 188 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:09:37.928129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-27ef9c6a-5c8c-4df1-b826-e05967a46e90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:37.928619 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-27ef9c6a-5c8c-4df1-b826-e05967a46e90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:37.931128 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=60 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:37.935817 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-27ef9c6a-5c8c-4df1-b826-e05967a46e90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:37.936267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-27ef9c6a-5c8c-4df1-b826-e05967a46e90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:37.937025 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-27ef9c6a-5c8c-4df1-b826-e05967a46e90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:37.937530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-27ef9c6a-5c8c-4df1-b826-e05967a46e90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:38.579165 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-27ef9c6a-5c8c-4df1-b826-e05967a46e90 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "DELETE /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/os-volume_attachments/61980537-777a-4a9f-a567-3d0435c1393e" status: 202 len: 0 microversion: 2.20 time: 0.655110 May 26 17:09:38.579763 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 587/1201] 10.222.0.112 () {60 vars in 1461 bytes} [Thu May 26 17:09:37 2022] DELETE /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/os-volume_attachments/61980537-777a-4a9f-a567-3d0435c1393e => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 17:09:38.637124 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1d3cd334-2dce-4ce1-8027-ddc3b9892843 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:09:38.637700 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1d3cd334-2dce-4ce1-8027-ddc3b9892843 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:38.644138 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1d3cd334-2dce-4ce1-8027-ddc3b9892843 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:38.644679 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1d3cd334-2dce-4ce1-8027-ddc3b9892843 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:38.645438 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1d3cd334-2dce-4ce1-8027-ddc3b9892843 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:38.645869 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1d3cd334-2dce-4ce1-8027-ddc3b9892843 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:38.867053 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1d3cd334-2dce-4ce1-8027-ddc3b9892843 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "POST /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/action" status: 202 len: 0 microversion: 2.20 time: 0.233748 May 26 17:09:38.869238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 615/1202] 10.222.0.112 () {62 vars in 1323 bytes} [Thu May 26 17:09:38 2022] POST /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 17:09:38.875879 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-203bf1d0-f520-4834-b28f-b0502b9d9532 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:38.876499 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-203bf1d0-f520-4834-b28f-b0502b9d9532 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:38.883494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-203bf1d0-f520-4834-b28f-b0502b9d9532 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:38.883951 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-203bf1d0-f520-4834-b28f-b0502b9d9532 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:38.884731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-203bf1d0-f520-4834-b28f-b0502b9d9532 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:38.885164 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-203bf1d0-f520-4834-b28f-b0502b9d9532 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:39.019385 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-203bf1d0-f520-4834-b28f-b0502b9d9532 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:39.026966 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-203bf1d0-f520-4834-b28f-b0502b9d9532 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:39.028495 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-203bf1d0-f520-4834-b28f-b0502b9d9532 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:39.029651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-203bf1d0-f520-4834-b28f-b0502b9d9532 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1677 microversion: 2.20 time: 0.157758 May 26 17:09:39.030217 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 588/1203] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:38 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:40.048911 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c9ccf5db-28bb-42df-8aa1-476a14800a0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:40.049428 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c9ccf5db-28bb-42df-8aa1-476a14800a0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:40.056665 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c9ccf5db-28bb-42df-8aa1-476a14800a0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:40.057121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c9ccf5db-28bb-42df-8aa1-476a14800a0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:40.057890 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c9ccf5db-28bb-42df-8aa1-476a14800a0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:40.058350 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c9ccf5db-28bb-42df-8aa1-476a14800a0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:40.204471 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c9ccf5db-28bb-42df-8aa1-476a14800a0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:40.213507 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c9ccf5db-28bb-42df-8aa1-476a14800a0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:40.215277 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c9ccf5db-28bb-42df-8aa1-476a14800a0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:40.216441 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c9ccf5db-28bb-42df-8aa1-476a14800a0b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1677 microversion: 2.20 time: 0.171529 May 26 17:09:40.217003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 616/1204] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:40 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:41.234170 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-468153da-0466-4d18-b417-d1f3d383135f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:41.234865 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-468153da-0466-4d18-b417-d1f3d383135f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:41.242163 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-468153da-0466-4d18-b417-d1f3d383135f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:41.242726 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-468153da-0466-4d18-b417-d1f3d383135f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:41.243591 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-468153da-0466-4d18-b417-d1f3d383135f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:41.244098 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-468153da-0466-4d18-b417-d1f3d383135f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:41.448396 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-468153da-0466-4d18-b417-d1f3d383135f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:41.457173 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-468153da-0466-4d18-b417-d1f3d383135f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:41.458710 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-468153da-0466-4d18-b417-d1f3d383135f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:41.459898 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-468153da-0466-4d18-b417-d1f3d383135f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.229587 May 26 17:09:41.460493 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 589/1205] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:41 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:42.478499 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f6b9ed3d-0ef1-4faf-bdc3-d816ae6553a7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:42.479157 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f6b9ed3d-0ef1-4faf-bdc3-d816ae6553a7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:42.486058 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f6b9ed3d-0ef1-4faf-bdc3-d816ae6553a7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:42.486543 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f6b9ed3d-0ef1-4faf-bdc3-d816ae6553a7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:42.487836 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f6b9ed3d-0ef1-4faf-bdc3-d816ae6553a7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:42.488338 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f6b9ed3d-0ef1-4faf-bdc3-d816ae6553a7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:42.626093 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f6b9ed3d-0ef1-4faf-bdc3-d816ae6553a7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:42.630179 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:42.637695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f6b9ed3d-0ef1-4faf-bdc3-d816ae6553a7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:42.639327 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f6b9ed3d-0ef1-4faf-bdc3-d816ae6553a7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:42.640507 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f6b9ed3d-0ef1-4faf-bdc3-d816ae6553a7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.166139 May 26 17:09:42.641073 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 617/1206] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:42 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:43.659820 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-eb22b0b8-717c-4df1-9ed9-ef1b29c2042b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:43.660416 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-eb22b0b8-717c-4df1-9ed9-ef1b29c2042b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:43.666986 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb22b0b8-717c-4df1-9ed9-ef1b29c2042b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:43.667427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb22b0b8-717c-4df1-9ed9-ef1b29c2042b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:43.668221 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb22b0b8-717c-4df1-9ed9-ef1b29c2042b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:43.668627 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-eb22b0b8-717c-4df1-9ed9-ef1b29c2042b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:43.810863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-eb22b0b8-717c-4df1-9ed9-ef1b29c2042b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:43.819761 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-eb22b0b8-717c-4df1-9ed9-ef1b29c2042b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:43.821351 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-eb22b0b8-717c-4df1-9ed9-ef1b29c2042b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:43.822636 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-eb22b0b8-717c-4df1-9ed9-ef1b29c2042b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.166960 May 26 17:09:43.829814 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 590/1207] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:43 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:44.847451 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e3209a44-494e-45a4-a7c6-c9652e4c3185 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:44.848899 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e3209a44-494e-45a4-a7c6-c9652e4c3185 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:44.856957 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e3209a44-494e-45a4-a7c6-c9652e4c3185 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:44.857403 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e3209a44-494e-45a4-a7c6-c9652e4c3185 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:44.858398 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e3209a44-494e-45a4-a7c6-c9652e4c3185 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:44.862185 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e3209a44-494e-45a4-a7c6-c9652e4c3185 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:45.004307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e3209a44-494e-45a4-a7c6-c9652e4c3185 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:45.012735 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e3209a44-494e-45a4-a7c6-c9652e4c3185 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:45.014254 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e3209a44-494e-45a4-a7c6-c9652e4c3185 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:45.015470 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e3209a44-494e-45a4-a7c6-c9652e4c3185 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.172966 May 26 17:09:45.016039 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 618/1208] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:44 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:46.035538 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d892ee98-ba12-4353-b558-65990f486e01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:46.036132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d892ee98-ba12-4353-b558-65990f486e01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:46.042791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d892ee98-ba12-4353-b558-65990f486e01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:46.043241 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d892ee98-ba12-4353-b558-65990f486e01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:46.044010 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d892ee98-ba12-4353-b558-65990f486e01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:46.044476 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d892ee98-ba12-4353-b558-65990f486e01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:46.047251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:46.193180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d892ee98-ba12-4353-b558-65990f486e01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:46.201049 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d892ee98-ba12-4353-b558-65990f486e01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:46.202875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d892ee98-ba12-4353-b558-65990f486e01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:46.204027 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d892ee98-ba12-4353-b558-65990f486e01 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.172976 May 26 17:09:46.204584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 591/1209] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:46 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:47.222906 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-836a12af-24bc-4bfb-986d-c1b6f914bc61 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:47.223551 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-836a12af-24bc-4bfb-986d-c1b6f914bc61 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:47.230094 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-836a12af-24bc-4bfb-986d-c1b6f914bc61 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:47.230578 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-836a12af-24bc-4bfb-986d-c1b6f914bc61 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:47.231350 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-836a12af-24bc-4bfb-986d-c1b6f914bc61 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:47.231789 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-836a12af-24bc-4bfb-986d-c1b6f914bc61 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:47.361869 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-836a12af-24bc-4bfb-986d-c1b6f914bc61 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:47.370801 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-836a12af-24bc-4bfb-986d-c1b6f914bc61 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:47.372336 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-836a12af-24bc-4bfb-986d-c1b6f914bc61 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:47.373512 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-836a12af-24bc-4bfb-986d-c1b6f914bc61 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.155026 May 26 17:09:47.374231 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 619/1210] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:47 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:48.394111 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7e349769-cb2e-4bb9-9a0a-9238c825e5f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:48.394765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7e349769-cb2e-4bb9-9a0a-9238c825e5f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:48.401075 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7e349769-cb2e-4bb9-9a0a-9238c825e5f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:48.401672 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7e349769-cb2e-4bb9-9a0a-9238c825e5f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:48.402472 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7e349769-cb2e-4bb9-9a0a-9238c825e5f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:48.402901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7e349769-cb2e-4bb9-9a0a-9238c825e5f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:48.532026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7e349769-cb2e-4bb9-9a0a-9238c825e5f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:48.547051 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7e349769-cb2e-4bb9-9a0a-9238c825e5f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:48.548548 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-7e349769-cb2e-4bb9-9a0a-9238c825e5f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:48.549716 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7e349769-cb2e-4bb9-9a0a-9238c825e5f1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.161100 May 26 17:09:48.550526 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 592/1211] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:48 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:49.567894 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-101b98e1-fe47-4da8-9880-e8ab0c714052 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:49.568446 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-101b98e1-fe47-4da8-9880-e8ab0c714052 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:49.575327 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-101b98e1-fe47-4da8-9880-e8ab0c714052 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:49.575769 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-101b98e1-fe47-4da8-9880-e8ab0c714052 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:49.576533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-101b98e1-fe47-4da8-9880-e8ab0c714052 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:49.577336 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-101b98e1-fe47-4da8-9880-e8ab0c714052 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:49.729821 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-101b98e1-fe47-4da8-9880-e8ab0c714052 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:49.742765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-101b98e1-fe47-4da8-9880-e8ab0c714052 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:49.745309 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-101b98e1-fe47-4da8-9880-e8ab0c714052 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:49.748178 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-101b98e1-fe47-4da8-9880-e8ab0c714052 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.184698 May 26 17:09:49.749645 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 620/1212] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:49 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:50.773587 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-db443b0e-8954-446f-9837-f40acb22e42a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:50.774358 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-db443b0e-8954-446f-9837-f40acb22e42a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:50.781184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-db443b0e-8954-446f-9837-f40acb22e42a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:50.781645 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-db443b0e-8954-446f-9837-f40acb22e42a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:50.782885 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-db443b0e-8954-446f-9837-f40acb22e42a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:50.783095 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-db443b0e-8954-446f-9837-f40acb22e42a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:50.923192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-db443b0e-8954-446f-9837-f40acb22e42a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:50.932044 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-db443b0e-8954-446f-9837-f40acb22e42a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:50.933529 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-db443b0e-8954-446f-9837-f40acb22e42a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:50.934728 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-db443b0e-8954-446f-9837-f40acb22e42a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.165180 May 26 17:09:50.935288 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 593/1213] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:50 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:51.953242 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-be3bf4a1-c8f1-49c4-9637-05603110a7bc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:51.953850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-be3bf4a1-c8f1-49c4-9637-05603110a7bc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:51.961241 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-be3bf4a1-c8f1-49c4-9637-05603110a7bc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:51.961695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-be3bf4a1-c8f1-49c4-9637-05603110a7bc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:51.962502 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-be3bf4a1-c8f1-49c4-9637-05603110a7bc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:51.962942 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-be3bf4a1-c8f1-49c4-9637-05603110a7bc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:52.099453 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-be3bf4a1-c8f1-49c4-9637-05603110a7bc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:52.109006 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-be3bf4a1-c8f1-49c4-9637-05603110a7bc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:52.110387 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-be3bf4a1-c8f1-49c4-9637-05603110a7bc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:52.111562 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-be3bf4a1-c8f1-49c4-9637-05603110a7bc tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.162493 May 26 17:09:52.112136 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 621/1214] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:51 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:53.131331 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-015a4f10-628d-4963-81ee-2445dd0e78e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:53.131867 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-015a4f10-628d-4963-81ee-2445dd0e78e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:53.138629 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-015a4f10-628d-4963-81ee-2445dd0e78e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:53.139074 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-015a4f10-628d-4963-81ee-2445dd0e78e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:53.139845 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-015a4f10-628d-4963-81ee-2445dd0e78e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:53.140272 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-015a4f10-628d-4963-81ee-2445dd0e78e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:53.272842 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-015a4f10-628d-4963-81ee-2445dd0e78e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:53.282646 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-015a4f10-628d-4963-81ee-2445dd0e78e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:53.284173 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-015a4f10-628d-4963-81ee-2445dd0e78e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:53.285876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-015a4f10-628d-4963-81ee-2445dd0e78e4 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.159224 May 26 17:09:53.296771 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 594/1215] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:53 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:54.304575 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-398bb0da-4a09-4c4e-9a8e-1304e4ac5943 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:54.305201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-398bb0da-4a09-4c4e-9a8e-1304e4ac5943 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:54.311890 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-398bb0da-4a09-4c4e-9a8e-1304e4ac5943 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:54.312339 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-398bb0da-4a09-4c4e-9a8e-1304e4ac5943 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:54.313103 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-398bb0da-4a09-4c4e-9a8e-1304e4ac5943 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:54.313545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-398bb0da-4a09-4c4e-9a8e-1304e4ac5943 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:54.457928 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-398bb0da-4a09-4c4e-9a8e-1304e4ac5943 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:54.466779 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-398bb0da-4a09-4c4e-9a8e-1304e4ac5943 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:54.468300 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-398bb0da-4a09-4c4e-9a8e-1304e4ac5943 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:54.469488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-398bb0da-4a09-4c4e-9a8e-1304e4ac5943 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.169083 May 26 17:09:54.470054 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 622/1216] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:54 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:55.489229 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d5fef48b-1724-41d8-877c-03a32fb48bb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:55.489835 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d5fef48b-1724-41d8-877c-03a32fb48bb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:55.496349 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d5fef48b-1724-41d8-877c-03a32fb48bb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:55.496804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d5fef48b-1724-41d8-877c-03a32fb48bb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:55.497564 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d5fef48b-1724-41d8-877c-03a32fb48bb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:55.497997 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d5fef48b-1724-41d8-877c-03a32fb48bb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:55.629833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d5fef48b-1724-41d8-877c-03a32fb48bb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:55.638245 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d5fef48b-1724-41d8-877c-03a32fb48bb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:55.640064 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d5fef48b-1724-41d8-877c-03a32fb48bb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:55.641502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d5fef48b-1724-41d8-877c-03a32fb48bb7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.156676 May 26 17:09:55.642211 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 595/1217] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:55 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:56.661491 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7d06579c-c25a-48aa-8819-6b788f4e3cff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:56.662104 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7d06579c-c25a-48aa-8819-6b788f4e3cff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:56.668198 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7d06579c-c25a-48aa-8819-6b788f4e3cff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:56.668645 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7d06579c-c25a-48aa-8819-6b788f4e3cff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:56.669399 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7d06579c-c25a-48aa-8819-6b788f4e3cff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:56.669829 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7d06579c-c25a-48aa-8819-6b788f4e3cff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:56.803342 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7d06579c-c25a-48aa-8819-6b788f4e3cff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:56.812620 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7d06579c-c25a-48aa-8819-6b788f4e3cff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:56.814065 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7d06579c-c25a-48aa-8819-6b788f4e3cff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:56.815276 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7d06579c-c25a-48aa-8819-6b788f4e3cff tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.158415 May 26 17:09:56.826807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 623/1218] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:56 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:57.834209 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2fdcd0e8-347c-4d59-a064-d6acf059a566 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:57.834873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-2fdcd0e8-347c-4d59-a064-d6acf059a566 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:57.842022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2fdcd0e8-347c-4d59-a064-d6acf059a566 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:57.842506 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2fdcd0e8-347c-4d59-a064-d6acf059a566 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:57.843272 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2fdcd0e8-347c-4d59-a064-d6acf059a566 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:57.843702 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2fdcd0e8-347c-4d59-a064-d6acf059a566 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:57.988566 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2fdcd0e8-347c-4d59-a064-d6acf059a566 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:57.998270 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2fdcd0e8-347c-4d59-a064-d6acf059a566 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:58.000122 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2fdcd0e8-347c-4d59-a064-d6acf059a566 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:58.001841 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-2fdcd0e8-347c-4d59-a064-d6acf059a566 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.171374 May 26 17:09:58.002651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 596/1219] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:57 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:09:59.023203 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7c65a3fa-e3d3-4b2e-b24f-4f63fffa5ac1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:09:59.023814 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7c65a3fa-e3d3-4b2e-b24f-4f63fffa5ac1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:09:59.030464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c65a3fa-e3d3-4b2e-b24f-4f63fffa5ac1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:59.030944 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c65a3fa-e3d3-4b2e-b24f-4f63fffa5ac1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:59.031716 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c65a3fa-e3d3-4b2e-b24f-4f63fffa5ac1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:09:59.032155 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7c65a3fa-e3d3-4b2e-b24f-4f63fffa5ac1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:09:59.172491 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7c65a3fa-e3d3-4b2e-b24f-4f63fffa5ac1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:59.181647 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7c65a3fa-e3d3-4b2e-b24f-4f63fffa5ac1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:59.183166 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7c65a3fa-e3d3-4b2e-b24f-4f63fffa5ac1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:09:59.184618 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7c65a3fa-e3d3-4b2e-b24f-4f63fffa5ac1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.165438 May 26 17:09:59.185180 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 624/1220] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:09:59 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:00.214126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-498bc198-8374-4a79-b232-fe4a02b9221c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:00.214126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-498bc198-8374-4a79-b232-fe4a02b9221c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:00.214126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-498bc198-8374-4a79-b232-fe4a02b9221c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:00.214126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-498bc198-8374-4a79-b232-fe4a02b9221c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:00.214911 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-498bc198-8374-4a79-b232-fe4a02b9221c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:00.214911 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-498bc198-8374-4a79-b232-fe4a02b9221c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:00.350129 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-498bc198-8374-4a79-b232-fe4a02b9221c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:00.357951 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-498bc198-8374-4a79-b232-fe4a02b9221c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:00.359520 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-498bc198-8374-4a79-b232-fe4a02b9221c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:00.360666 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-498bc198-8374-4a79-b232-fe4a02b9221c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.160536 May 26 17:10:00.361236 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 597/1221] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:00 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:01.380797 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-fae1a060-e1d4-4fe1-a18b-91d46b98000f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:01.381406 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-fae1a060-e1d4-4fe1-a18b-91d46b98000f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:01.383727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=36 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:01.388389 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fae1a060-e1d4-4fe1-a18b-91d46b98000f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:01.388900 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fae1a060-e1d4-4fe1-a18b-91d46b98000f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:01.389698 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fae1a060-e1d4-4fe1-a18b-91d46b98000f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:01.390126 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-fae1a060-e1d4-4fe1-a18b-91d46b98000f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:01.525462 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fae1a060-e1d4-4fe1-a18b-91d46b98000f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:01.533682 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fae1a060-e1d4-4fe1-a18b-91d46b98000f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:01.536314 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-fae1a060-e1d4-4fe1-a18b-91d46b98000f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:01.537479 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-fae1a060-e1d4-4fe1-a18b-91d46b98000f tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.161103 May 26 17:10:01.538041 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 625/1222] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:01 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:02.556239 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-213e8d4d-8b59-40c6-bc0b-eff379a0801d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:02.556868 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-213e8d4d-8b59-40c6-bc0b-eff379a0801d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:02.564479 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-213e8d4d-8b59-40c6-bc0b-eff379a0801d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:02.564928 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-213e8d4d-8b59-40c6-bc0b-eff379a0801d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:02.566362 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-213e8d4d-8b59-40c6-bc0b-eff379a0801d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:02.566986 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-213e8d4d-8b59-40c6-bc0b-eff379a0801d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:02.945482 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-213e8d4d-8b59-40c6-bc0b-eff379a0801d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:02.953553 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-213e8d4d-8b59-40c6-bc0b-eff379a0801d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:02.955077 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-213e8d4d-8b59-40c6-bc0b-eff379a0801d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:02.956259 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-213e8d4d-8b59-40c6-bc0b-eff379a0801d tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.404086 May 26 17:10:02.957109 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 598/1223] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:02 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:03.974841 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d763b311-b99f-4fa2-bb95-320740498a9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:03.975461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d763b311-b99f-4fa2-bb95-320740498a9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:03.982089 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d763b311-b99f-4fa2-bb95-320740498a9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:03.982576 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d763b311-b99f-4fa2-bb95-320740498a9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:03.983340 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d763b311-b99f-4fa2-bb95-320740498a9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:03.983786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d763b311-b99f-4fa2-bb95-320740498a9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:04.110938 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d763b311-b99f-4fa2-bb95-320740498a9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:04.119360 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d763b311-b99f-4fa2-bb95-320740498a9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:04.120848 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d763b311-b99f-4fa2-bb95-320740498a9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:04.121992 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d763b311-b99f-4fa2-bb95-320740498a9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.151130 May 26 17:10:04.122578 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 626/1224] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:03 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:05.141131 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ce459642-5359-4b34-9e74-68ab50d2a129 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:05.141770 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ce459642-5359-4b34-9e74-68ab50d2a129 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:05.148973 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ce459642-5359-4b34-9e74-68ab50d2a129 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:05.149422 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ce459642-5359-4b34-9e74-68ab50d2a129 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:05.150190 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ce459642-5359-4b34-9e74-68ab50d2a129 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:05.150662 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ce459642-5359-4b34-9e74-68ab50d2a129 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:05.278415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ce459642-5359-4b34-9e74-68ab50d2a129 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:05.286294 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ce459642-5359-4b34-9e74-68ab50d2a129 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:05.290729 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ce459642-5359-4b34-9e74-68ab50d2a129 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:05.292499 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ce459642-5359-4b34-9e74-68ab50d2a129 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.154992 May 26 17:10:05.293072 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 599/1225] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:05 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:06.312291 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-95a810b7-c47f-4d6a-8fe8-8903e4999729 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:06.312932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-95a810b7-c47f-4d6a-8fe8-8903e4999729 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:06.320599 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-95a810b7-c47f-4d6a-8fe8-8903e4999729 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:06.321094 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-95a810b7-c47f-4d6a-8fe8-8903e4999729 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:06.321870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-95a810b7-c47f-4d6a-8fe8-8903e4999729 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:06.322305 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-95a810b7-c47f-4d6a-8fe8-8903e4999729 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:06.465955 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-95a810b7-c47f-4d6a-8fe8-8903e4999729 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:06.475579 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-95a810b7-c47f-4d6a-8fe8-8903e4999729 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:06.477134 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-95a810b7-c47f-4d6a-8fe8-8903e4999729 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:06.478367 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-95a810b7-c47f-4d6a-8fe8-8903e4999729 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.169945 May 26 17:10:06.478941 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 627/1226] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:06 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:07.497448 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0065cabb-38cd-4f18-9aad-382a1f7b86be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:07.498007 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0065cabb-38cd-4f18-9aad-382a1f7b86be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:07.504573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0065cabb-38cd-4f18-9aad-382a1f7b86be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:07.505049 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0065cabb-38cd-4f18-9aad-382a1f7b86be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:07.511394 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0065cabb-38cd-4f18-9aad-382a1f7b86be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:07.511394 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0065cabb-38cd-4f18-9aad-382a1f7b86be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:07.639816 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0065cabb-38cd-4f18-9aad-382a1f7b86be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:07.649185 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0065cabb-38cd-4f18-9aad-382a1f7b86be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:07.651158 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0065cabb-38cd-4f18-9aad-382a1f7b86be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:07.652313 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0065cabb-38cd-4f18-9aad-382a1f7b86be tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.158820 May 26 17:10:07.652880 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 600/1227] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:07 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:08.671479 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a46910c8-9c3d-4cc7-9176-e44f70fc3cb9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:08.672085 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a46910c8-9c3d-4cc7-9176-e44f70fc3cb9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:08.679557 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a46910c8-9c3d-4cc7-9176-e44f70fc3cb9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:08.680019 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a46910c8-9c3d-4cc7-9176-e44f70fc3cb9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:08.680789 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a46910c8-9c3d-4cc7-9176-e44f70fc3cb9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:08.681231 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a46910c8-9c3d-4cc7-9176-e44f70fc3cb9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:08.809133 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a46910c8-9c3d-4cc7-9176-e44f70fc3cb9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:08.818290 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a46910c8-9c3d-4cc7-9176-e44f70fc3cb9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:08.819757 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a46910c8-9c3d-4cc7-9176-e44f70fc3cb9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:08.820924 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a46910c8-9c3d-4cc7-9176-e44f70fc3cb9 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.153365 May 26 17:10:08.821486 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 628/1228] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:08 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:09.839588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b66790c8-2171-4465-893d-24d2b886f445 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:09.840144 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b66790c8-2171-4465-893d-24d2b886f445 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:09.842100 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=28 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:09.846830 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b66790c8-2171-4465-893d-24d2b886f445 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:09.847516 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b66790c8-2171-4465-893d-24d2b886f445 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:09.848163 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b66790c8-2171-4465-893d-24d2b886f445 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:09.848597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b66790c8-2171-4465-893d-24d2b886f445 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:09.974754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b66790c8-2171-4465-893d-24d2b886f445 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:09.982653 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b66790c8-2171-4465-893d-24d2b886f445 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:09.984224 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b66790c8-2171-4465-893d-24d2b886f445 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:09.985380 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b66790c8-2171-4465-893d-24d2b886f445 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.149814 May 26 17:10:09.985954 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 601/1229] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:09 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:10:11.005017 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-36e67c87-2ce2-45ea-ba9f-a9f732f35dab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:11.005611 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-36e67c87-2ce2-45ea-ba9f-a9f732f35dab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:11.012020 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-36e67c87-2ce2-45ea-ba9f-a9f732f35dab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:11.012458 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-36e67c87-2ce2-45ea-ba9f-a9f732f35dab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:11.013204 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-36e67c87-2ce2-45ea-ba9f-a9f732f35dab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:11.013631 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-36e67c87-2ce2-45ea-ba9f-a9f732f35dab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:11.143096 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-36e67c87-2ce2-45ea-ba9f-a9f732f35dab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:11.151654 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-36e67c87-2ce2-45ea-ba9f-a9f732f35dab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:11.153142 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-36e67c87-2ce2-45ea-ba9f-a9f732f35dab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:11.154297 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-36e67c87-2ce2-45ea-ba9f-a9f732f35dab tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.154002 May 26 17:10:11.154868 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 629/1230] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:10 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:12.172790 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-caa027d0-3c63-4ec1-b0e1-9fc4631a9af3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:12.173407 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-caa027d0-3c63-4ec1-b0e1-9fc4631a9af3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:12.180569 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-caa027d0-3c63-4ec1-b0e1-9fc4631a9af3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:12.181022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-caa027d0-3c63-4ec1-b0e1-9fc4631a9af3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:12.181798 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-caa027d0-3c63-4ec1-b0e1-9fc4631a9af3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:12.182236 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-caa027d0-3c63-4ec1-b0e1-9fc4631a9af3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:12.313873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-caa027d0-3c63-4ec1-b0e1-9fc4631a9af3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:12.322112 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-caa027d0-3c63-4ec1-b0e1-9fc4631a9af3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:12.323666 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-caa027d0-3c63-4ec1-b0e1-9fc4631a9af3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:12.324832 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-caa027d0-3c63-4ec1-b0e1-9fc4631a9af3 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.156307 May 26 17:10:12.325401 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 602/1231] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:12 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:13.344457 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3f829bcb-d25c-43ea-abdf-764b4faf14aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:13.345096 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3f829bcb-d25c-43ea-abdf-764b4faf14aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:13.352228 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f829bcb-d25c-43ea-abdf-764b4faf14aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:13.352681 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f829bcb-d25c-43ea-abdf-764b4faf14aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:13.353442 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f829bcb-d25c-43ea-abdf-764b4faf14aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:13.353883 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3f829bcb-d25c-43ea-abdf-764b4faf14aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:13.485677 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3f829bcb-d25c-43ea-abdf-764b4faf14aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:13.493986 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3f829bcb-d25c-43ea-abdf-764b4faf14aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:13.495558 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3f829bcb-d25c-43ea-abdf-764b4faf14aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:13.496735 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3f829bcb-d25c-43ea-abdf-764b4faf14aa tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.156234 May 26 17:10:13.497301 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 630/1232] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:13 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:13.765297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-ec004588-2ced-4164-8e5d-d2741dff5c0b req-24bf669c-94db-44e2-835e-ff2c1e17297c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dca66e2-797a-492c-aa32-e2bb881ac25b", "name": "network-vif-plugged", "status": "completed", "tag": "4e63cdc0-f462-4b50-8bc7-40551bf2f0ba"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:10:13.777058 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-ec004588-2ced-4164-8e5d-d2741dff5c0b req-24bf669c-94db-44e2-835e-ff2c1e17297c service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:13.777501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-ec004588-2ced-4164-8e5d-d2741dff5c0b req-24bf669c-94db-44e2-835e-ff2c1e17297c service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:13.789783 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-ec004588-2ced-4164-8e5d-d2741dff5c0b req-24bf669c-94db-44e2-835e-ff2c1e17297c service nova] Creating event network-vif-plugged:4e63cdc0-f462-4b50-8bc7-40551bf2f0ba for instance 4dca66e2-797a-492c-aa32-e2bb881ac25b on hv-cinder-83607 May 26 17:10:13.795031 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-ec004588-2ced-4164-8e5d-d2741dff5c0b req-24bf669c-94db-44e2-835e-ff2c1e17297c service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033369 May 26 17:10:13.795651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 603/1233] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:10:14.515572 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-17452b20-538b-4d94-b84e-5f4cb6d1213b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:14.516112 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-17452b20-538b-4d94-b84e-5f4cb6d1213b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:14.523372 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17452b20-538b-4d94-b84e-5f4cb6d1213b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:14.523827 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17452b20-538b-4d94-b84e-5f4cb6d1213b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:14.524592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17452b20-538b-4d94-b84e-5f4cb6d1213b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:14.525030 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17452b20-538b-4d94-b84e-5f4cb6d1213b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:14.654409 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-17452b20-538b-4d94-b84e-5f4cb6d1213b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:14.663184 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-17452b20-538b-4d94-b84e-5f4cb6d1213b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:14.664648 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-17452b20-538b-4d94-b84e-5f4cb6d1213b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:14.665793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-17452b20-538b-4d94-b84e-5f4cb6d1213b tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.154278 May 26 17:10:14.666367 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 631/1234] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:14 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:15.684923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a4cf3365-2350-4126-af2c-97503e147d8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:15.685613 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a4cf3365-2350-4126-af2c-97503e147d8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:15.692939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a4cf3365-2350-4126-af2c-97503e147d8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:15.693378 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a4cf3365-2350-4126-af2c-97503e147d8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:15.694130 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a4cf3365-2350-4126-af2c-97503e147d8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:15.694583 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a4cf3365-2350-4126-af2c-97503e147d8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:15.825008 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a4cf3365-2350-4126-af2c-97503e147d8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:15.834139 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a4cf3365-2350-4126-af2c-97503e147d8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:15.835661 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a4cf3365-2350-4126-af2c-97503e147d8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:15.838233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a4cf3365-2350-4126-af2c-97503e147d8c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.156112 May 26 17:10:15.838233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 604/1235] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:15 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:16.855238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dcce8d1b-5c93-468e-b1f9-f4c9239f6a1a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:16.855779 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-dcce8d1b-5c93-468e-b1f9-f4c9239f6a1a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:16.862282 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dcce8d1b-5c93-468e-b1f9-f4c9239f6a1a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:16.862766 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dcce8d1b-5c93-468e-b1f9-f4c9239f6a1a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:16.863532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dcce8d1b-5c93-468e-b1f9-f4c9239f6a1a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:16.863975 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dcce8d1b-5c93-468e-b1f9-f4c9239f6a1a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:16.866545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=85 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:16.995590 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dcce8d1b-5c93-468e-b1f9-f4c9239f6a1a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:17.003930 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dcce8d1b-5c93-468e-b1f9-f4c9239f6a1a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:17.005448 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dcce8d1b-5c93-468e-b1f9-f4c9239f6a1a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:17.006639 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-dcce8d1b-5c93-468e-b1f9-f4c9239f6a1a tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.155359 May 26 17:10:17.011515 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 632/1236] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:16 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:18.024033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-72c9cfcb-b396-4ced-b88f-b1aec9fda27c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:18.024644 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-72c9cfcb-b396-4ced-b88f-b1aec9fda27c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:18.031144 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-72c9cfcb-b396-4ced-b88f-b1aec9fda27c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:18.031588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-72c9cfcb-b396-4ced-b88f-b1aec9fda27c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:18.032343 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-72c9cfcb-b396-4ced-b88f-b1aec9fda27c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:18.032775 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-72c9cfcb-b396-4ced-b88f-b1aec9fda27c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:18.035936 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=80 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:18.169380 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-72c9cfcb-b396-4ced-b88f-b1aec9fda27c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:18.177985 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-72c9cfcb-b396-4ced-b88f-b1aec9fda27c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:18.179506 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-72c9cfcb-b396-4ced-b88f-b1aec9fda27c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:18.180685 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-72c9cfcb-b396-4ced-b88f-b1aec9fda27c tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1735 microversion: 2.20 time: 0.160551 May 26 17:10:18.181236 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 605/1237] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:18 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:19.199798 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c5fe526a-4aa5-49c9-9ea4-09a40ac40cd1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:19.200465 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c5fe526a-4aa5-49c9-9ea4-09a40ac40cd1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:19.208110 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5fe526a-4aa5-49c9-9ea4-09a40ac40cd1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:19.208544 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5fe526a-4aa5-49c9-9ea4-09a40ac40cd1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:19.209368 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5fe526a-4aa5-49c9-9ea4-09a40ac40cd1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:19.209818 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c5fe526a-4aa5-49c9-9ea4-09a40ac40cd1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:19.343810 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c5fe526a-4aa5-49c9-9ea4-09a40ac40cd1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:19.352633 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c5fe526a-4aa5-49c9-9ea4-09a40ac40cd1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:19.354124 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c5fe526a-4aa5-49c9-9ea4-09a40ac40cd1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:19.355312 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c5fe526a-4aa5-49c9-9ea4-09a40ac40cd1 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1722 microversion: 2.20 time: 0.159601 May 26 17:10:19.355870 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 633/1238] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:10:19 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:10:21.788266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ab885355-4922-4a16-89a0-c79841398aa8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:21.788754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ab885355-4922-4a16-89a0-c79841398aa8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:21.794840 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab885355-4922-4a16-89a0-c79841398aa8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:21.795292 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab885355-4922-4a16-89a0-c79841398aa8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:21.796055 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab885355-4922-4a16-89a0-c79841398aa8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:21.796488 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab885355-4922-4a16-89a0-c79841398aa8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:21.820160 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ab885355-4922-4a16-89a0-c79841398aa8 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/ips" status: 200 len: 147 microversion: 2.1 time: 0.174581 May 26 17:10:21.820764 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 606/1239] 10.222.0.112 () {58 vars in 1252 bytes} [Thu May 26 17:10:21 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/ips => generated 147 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:10:24.630342 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2af9ec44-fdd4-4e26-81c4-f5adee49d7de tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1eefae5f-417f-43ca-a98e-169d8635edbc"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:10:24.631493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2af9ec44-fdd4-4e26-81c4-f5adee49d7de tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:24.638082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2af9ec44-fdd4-4e26-81c4-f5adee49d7de tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:24.638566 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2af9ec44-fdd4-4e26-81c4-f5adee49d7de tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:24.639324 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2af9ec44-fdd4-4e26-81c4-f5adee49d7de tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:24.639762 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2af9ec44-fdd4-4e26-81c4-f5adee49d7de tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:25.622435 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2af9ec44-fdd4-4e26-81c4-f5adee49d7de tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "POST /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.996381 May 26 17:10:25.623050 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 634/1240] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:10:24 2022] POST /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments => generated 194 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:10:35.227804 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-07b97dc5-0150-4a2a-a3a8-12fe5c174e17 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:35.229012 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-07b97dc5-0150-4a2a-a3a8-12fe5c174e17 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:35.231277 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=11 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:35.231944 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=9 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:35.236608 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-07b97dc5-0150-4a2a-a3a8-12fe5c174e17 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:35.237054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-07b97dc5-0150-4a2a-a3a8-12fe5c174e17 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:35.237826 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-07b97dc5-0150-4a2a-a3a8-12fe5c174e17 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:35.238264 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-07b97dc5-0150-4a2a-a3a8-12fe5c174e17 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:35.268815 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-07b97dc5-0150-4a2a-a3a8-12fe5c174e17 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045538 May 26 17:10:35.269426 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 607/1241] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:10:35 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:10:35.277328 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=19 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:35.281766 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2558cb26-697e-41cd-9208-2d796ff8c3ba tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:35.282369 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2558cb26-697e-41cd-9208-2d796ff8c3ba tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:35.289329 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2558cb26-697e-41cd-9208-2d796ff8c3ba tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:35.289779 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2558cb26-697e-41cd-9208-2d796ff8c3ba tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:35.290578 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2558cb26-697e-41cd-9208-2d796ff8c3ba tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:35.291016 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2558cb26-697e-41cd-9208-2d796ff8c3ba tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:35.320240 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2558cb26-697e-41cd-9208-2d796ff8c3ba tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments/1eefae5f-417f-43ca-a98e-169d8635edbc" status: 200 len: 194 microversion: 2.1 time: 0.044434 May 26 17:10:35.320834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 635/1242] 10.222.0.112 () {58 vars in 1417 bytes} [Thu May 26 17:10:35 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments/1eefae5f-417f-43ca-a98e-169d8635edbc => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:10:36.078428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cffec218-134a-4110-a21b-24bac35f416c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:10:36.079269 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cffec218-134a-4110-a21b-24bac35f416c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:36.086241 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cffec218-134a-4110-a21b-24bac35f416c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:36.086722 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cffec218-134a-4110-a21b-24bac35f416c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:36.087490 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cffec218-134a-4110-a21b-24bac35f416c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:36.087929 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cffec218-134a-4110-a21b-24bac35f416c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:36.110097 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-cffec218-134a-4110-a21b-24bac35f416c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lazy-loading 'flavor' on Instance uuid 5e658131-bdbf-45c9-ade8-47d384a77f9a {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:10:36.401504 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cffec218-134a-4110-a21b-24bac35f416c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "POST /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a/action" status: 202 len: 0 microversion: 2.1 time: 0.327559 May 26 17:10:36.402212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 608/1243] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:10:36 2022] POST /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:10:36.410485 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-78809420-1c45-4294-8cde-062cb7e6281b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:36.411284 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-78809420-1c45-4294-8cde-062cb7e6281b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:36.418115 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-78809420-1c45-4294-8cde-062cb7e6281b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:36.418855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-78809420-1c45-4294-8cde-062cb7e6281b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:36.419424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-78809420-1c45-4294-8cde-062cb7e6281b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:36.419868 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-78809420-1c45-4294-8cde-062cb7e6281b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:36.556824 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-78809420-1c45-4294-8cde-062cb7e6281b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:36.564492 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-78809420-1c45-4294-8cde-062cb7e6281b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.157949 May 26 17:10:36.565066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 636/1244] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:36 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:37.584062 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f63094bf-1198-40d8-8463-2b27c5f14679 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:37.586807 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f63094bf-1198-40d8-8463-2b27c5f14679 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:37.591259 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f63094bf-1198-40d8-8463-2b27c5f14679 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:37.591705 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f63094bf-1198-40d8-8463-2b27c5f14679 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:37.595850 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f63094bf-1198-40d8-8463-2b27c5f14679 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:37.595850 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f63094bf-1198-40d8-8463-2b27c5f14679 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:37.723483 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f63094bf-1198-40d8-8463-2b27c5f14679 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:37.731886 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f63094bf-1198-40d8-8463-2b27c5f14679 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.152692 May 26 17:10:37.732450 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 609/1245] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:37 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:38.008275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f696a99f-e577-4c02-a1cd-8c3e4ae02e36 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "214b6f97-0696-457f-9c53-1c9232bc2fc2"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:10:38.009375 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f696a99f-e577-4c02-a1cd-8c3e4ae02e36 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:38.015811 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f696a99f-e577-4c02-a1cd-8c3e4ae02e36 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:38.016270 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f696a99f-e577-4c02-a1cd-8c3e4ae02e36 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:38.017035 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f696a99f-e577-4c02-a1cd-8c3e4ae02e36 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:38.017474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f696a99f-e577-4c02-a1cd-8c3e4ae02e36 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:38.750203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f885cb8a-e28c-4616-8139-58b90ad25157 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:38.751463 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f885cb8a-e28c-4616-8139-58b90ad25157 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:38.757864 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f885cb8a-e28c-4616-8139-58b90ad25157 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:38.758315 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f885cb8a-e28c-4616-8139-58b90ad25157 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:38.759135 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f885cb8a-e28c-4616-8139-58b90ad25157 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:38.759568 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f885cb8a-e28c-4616-8139-58b90ad25157 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:38.871154 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f696a99f-e577-4c02-a1cd-8c3e4ae02e36 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "POST /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.866903 May 26 17:10:38.876629 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 637/1246] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:10:38 2022] POST /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments => generated 194 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:10:38.896421 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f885cb8a-e28c-4616-8139-58b90ad25157 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:38.904920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f885cb8a-e28c-4616-8139-58b90ad25157 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.159556 May 26 17:10:38.905537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 610/1247] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:38 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:10:39.923010 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8162bb01-7cac-43dd-b644-21bd17e7bcac tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:39.923734 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8162bb01-7cac-43dd-b644-21bd17e7bcac tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:39.931425 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8162bb01-7cac-43dd-b644-21bd17e7bcac tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:39.935991 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8162bb01-7cac-43dd-b644-21bd17e7bcac tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:39.935991 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8162bb01-7cac-43dd-b644-21bd17e7bcac tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:39.935991 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8162bb01-7cac-43dd-b644-21bd17e7bcac tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:40.106528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8162bb01-7cac-43dd-b644-21bd17e7bcac tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:40.106528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8162bb01-7cac-43dd-b644-21bd17e7bcac tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.181453 May 26 17:10:40.106528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 638/1248] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:39 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:10:41.118743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fad4b30a-3cca-4711-a0cf-f602225570c1 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:41.119361 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fad4b30a-3cca-4711-a0cf-f602225570c1 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:41.125812 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fad4b30a-3cca-4711-a0cf-f602225570c1 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:41.126261 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fad4b30a-3cca-4711-a0cf-f602225570c1 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:41.127087 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fad4b30a-3cca-4711-a0cf-f602225570c1 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:41.127525 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fad4b30a-3cca-4711-a0cf-f602225570c1 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:41.258192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fad4b30a-3cca-4711-a0cf-f602225570c1 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:41.265705 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fad4b30a-3cca-4711-a0cf-f602225570c1 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.151797 May 26 17:10:41.266286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 611/1249] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:41 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:42.282622 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-20b97d7b-8387-4eb5-bf89-41d054c6c418 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:42.283240 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-20b97d7b-8387-4eb5-bf89-41d054c6c418 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:42.290229 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-20b97d7b-8387-4eb5-bf89-41d054c6c418 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:42.290717 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-20b97d7b-8387-4eb5-bf89-41d054c6c418 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:42.291511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-20b97d7b-8387-4eb5-bf89-41d054c6c418 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:42.291951 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-20b97d7b-8387-4eb5-bf89-41d054c6c418 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:42.422154 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-20b97d7b-8387-4eb5-bf89-41d054c6c418 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:42.430749 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-20b97d7b-8387-4eb5-bf89-41d054c6c418 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.151932 May 26 17:10:42.431332 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 639/1250] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:42 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:43.446899 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3ebc5eee-a6f3-4d58-81b7-2e92a89ff8d9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:43.447627 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3ebc5eee-a6f3-4d58-81b7-2e92a89ff8d9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:43.454690 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3ebc5eee-a6f3-4d58-81b7-2e92a89ff8d9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:43.455151 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3ebc5eee-a6f3-4d58-81b7-2e92a89ff8d9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:43.455965 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3ebc5eee-a6f3-4d58-81b7-2e92a89ff8d9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:43.456404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3ebc5eee-a6f3-4d58-81b7-2e92a89ff8d9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:43.595873 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3ebc5eee-a6f3-4d58-81b7-2e92a89ff8d9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:43.604322 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3ebc5eee-a6f3-4d58-81b7-2e92a89ff8d9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.161266 May 26 17:10:43.604894 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 612/1251] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:43 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:44.621853 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2b79f4a3-1f8e-421b-9ead-5ce89af9c10d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:44.622522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2b79f4a3-1f8e-421b-9ead-5ce89af9c10d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:44.629010 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b79f4a3-1f8e-421b-9ead-5ce89af9c10d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:44.629460 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b79f4a3-1f8e-421b-9ead-5ce89af9c10d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:44.630227 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b79f4a3-1f8e-421b-9ead-5ce89af9c10d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:44.630689 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2b79f4a3-1f8e-421b-9ead-5ce89af9c10d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:44.981012 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2b79f4a3-1f8e-421b-9ead-5ce89af9c10d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:44.988601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2b79f4a3-1f8e-421b-9ead-5ce89af9c10d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.370739 May 26 17:10:44.989181 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 640/1252] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:44 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:46.006009 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c81ec2ab-fba1-48b1-8892-7cdddb0df33b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:46.007267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-c81ec2ab-fba1-48b1-8892-7cdddb0df33b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:46.013822 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c81ec2ab-fba1-48b1-8892-7cdddb0df33b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:46.014277 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c81ec2ab-fba1-48b1-8892-7cdddb0df33b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:46.015069 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c81ec2ab-fba1-48b1-8892-7cdddb0df33b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:46.015506 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-c81ec2ab-fba1-48b1-8892-7cdddb0df33b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:46.159795 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-c81ec2ab-fba1-48b1-8892-7cdddb0df33b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:46.168172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c81ec2ab-fba1-48b1-8892-7cdddb0df33b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.165881 May 26 17:10:46.168909 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 613/1253] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:46 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:47.185498 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5724dc83-bfcf-49fe-ae5c-ca97ad80edbe tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:47.186043 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5724dc83-bfcf-49fe-ae5c-ca97ad80edbe tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:47.192722 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5724dc83-bfcf-49fe-ae5c-ca97ad80edbe tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:47.193163 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5724dc83-bfcf-49fe-ae5c-ca97ad80edbe tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:47.194217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5724dc83-bfcf-49fe-ae5c-ca97ad80edbe tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:47.194972 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5724dc83-bfcf-49fe-ae5c-ca97ad80edbe tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:47.198744 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:47.329473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5724dc83-bfcf-49fe-ae5c-ca97ad80edbe tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:47.337884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5724dc83-bfcf-49fe-ae5c-ca97ad80edbe tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.156475 May 26 17:10:47.338702 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 641/1254] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:47 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:48.354295 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8f3cde48-9d4e-474c-822d-aa77d064335a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:48.354959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8f3cde48-9d4e-474c-822d-aa77d064335a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:48.361504 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f3cde48-9d4e-474c-822d-aa77d064335a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:48.361941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f3cde48-9d4e-474c-822d-aa77d064335a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:48.362726 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f3cde48-9d4e-474c-822d-aa77d064335a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:48.363155 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f3cde48-9d4e-474c-822d-aa77d064335a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:48.480260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-89df622a-2288-4b29-bb86-c6a2a40c6920 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:48.481288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-89df622a-2288-4b29-bb86-c6a2a40c6920 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:48.488267 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-89df622a-2288-4b29-bb86-c6a2a40c6920 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:48.488721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-89df622a-2288-4b29-bb86-c6a2a40c6920 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:48.489500 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-89df622a-2288-4b29-bb86-c6a2a40c6920 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:48.489941 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-89df622a-2288-4b29-bb86-c6a2a40c6920 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:48.500514 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8f3cde48-9d4e-474c-822d-aa77d064335a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:48.509278 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8f3cde48-9d4e-474c-822d-aa77d064335a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.158908 May 26 17:10:48.509862 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 614/1255] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:48 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:48.521210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-89df622a-2288-4b29-bb86-c6a2a40c6920 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044919 May 26 17:10:48.521964 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 642/1256] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:10:48 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:10:48.673309 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ed23be7e-e1a6-48f8-a942-bb7d7861efb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:48.673803 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ed23be7e-e1a6-48f8-a942-bb7d7861efb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:48.680992 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed23be7e-e1a6-48f8-a942-bb7d7861efb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:48.681449 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed23be7e-e1a6-48f8-a942-bb7d7861efb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:48.682223 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed23be7e-e1a6-48f8-a942-bb7d7861efb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:48.682695 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ed23be7e-e1a6-48f8-a942-bb7d7861efb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:48.712856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ed23be7e-e1a6-48f8-a942-bb7d7861efb9 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments/1eefae5f-417f-43ca-a98e-169d8635edbc" status: 200 len: 194 microversion: 2.1 time: 0.042501 May 26 17:10:48.712856 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 615/1257] 10.222.0.112 () {58 vars in 1417 bytes} [Thu May 26 17:10:48 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments/1eefae5f-417f-43ca-a98e-169d8635edbc => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:10:48.721557 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a244a7e7-aa6c-4fdc-9d15-c83477b3e0df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:48.722054 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a244a7e7-aa6c-4fdc-9d15-c83477b3e0df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:48.728627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a244a7e7-aa6c-4fdc-9d15-c83477b3e0df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:48.729079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a244a7e7-aa6c-4fdc-9d15-c83477b3e0df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:48.729850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a244a7e7-aa6c-4fdc-9d15-c83477b3e0df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:48.730293 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a244a7e7-aa6c-4fdc-9d15-c83477b3e0df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:48.811001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-a244a7e7-aa6c-4fdc-9d15-c83477b3e0df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lazy-loading 'services' on Instance uuid 1d85e129-1f91-4dd5-a330-867543373c26 {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:10:49.054970 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a244a7e7-aa6c-4fdc-9d15-c83477b3e0df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "DELETE /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments/1eefae5f-417f-43ca-a98e-169d8635edbc" status: 202 len: 0 microversion: 2.1 time: 0.337074 May 26 17:10:49.055609 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 643/1258] 10.222.0.112 () {58 vars in 1420 bytes} [Thu May 26 17:10:48 2022] DELETE /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments/1eefae5f-417f-43ca-a98e-169d8635edbc => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:10:49.527328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a29e5838-6dcc-4658-967b-f0a01d07e357 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:49.527886 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a29e5838-6dcc-4658-967b-f0a01d07e357 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:49.534470 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a29e5838-6dcc-4658-967b-f0a01d07e357 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:49.534919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a29e5838-6dcc-4658-967b-f0a01d07e357 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:49.535688 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a29e5838-6dcc-4658-967b-f0a01d07e357 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:49.536123 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a29e5838-6dcc-4658-967b-f0a01d07e357 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:49.675043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a29e5838-6dcc-4658-967b-f0a01d07e357 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:49.682503 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a29e5838-6dcc-4658-967b-f0a01d07e357 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.159134 May 26 17:10:49.683063 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 616/1259] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:49 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:50.701410 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b6f05cd8-8c34-4a9a-9c19-c86b69c238ed tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:50.702110 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b6f05cd8-8c34-4a9a-9c19-c86b69c238ed tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:50.708769 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b6f05cd8-8c34-4a9a-9c19-c86b69c238ed tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:50.710461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b6f05cd8-8c34-4a9a-9c19-c86b69c238ed tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:50.711078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b6f05cd8-8c34-4a9a-9c19-c86b69c238ed tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:50.711078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b6f05cd8-8c34-4a9a-9c19-c86b69c238ed tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:50.851546 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b6f05cd8-8c34-4a9a-9c19-c86b69c238ed tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:50.859151 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b6f05cd8-8c34-4a9a-9c19-c86b69c238ed tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.162475 May 26 17:10:50.859728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 644/1260] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:50 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:51.235582 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-73172639-0027-436e-81d9-ef091c7362a4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:51.236069 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-73172639-0027-436e-81d9-ef091c7362a4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:51.242977 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-73172639-0027-436e-81d9-ef091c7362a4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:51.243420 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-73172639-0027-436e-81d9-ef091c7362a4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:51.244168 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-73172639-0027-436e-81d9-ef091c7362a4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:51.244595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-73172639-0027-436e-81d9-ef091c7362a4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:51.274095 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-73172639-0027-436e-81d9-ef091c7362a4 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments/214b6f97-0696-457f-9c53-1c9232bc2fc2" status: 200 len: 194 microversion: 2.1 time: 0.042429 May 26 17:10:51.274739 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 617/1261] 10.222.0.112 () {58 vars in 1417 bytes} [Thu May 26 17:10:51 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments/214b6f97-0696-457f-9c53-1c9232bc2fc2 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:10:51.284473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c30191f5-e3c5-4133-baa0-2388fc7a9392 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:51.285197 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c30191f5-e3c5-4133-baa0-2388fc7a9392 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:51.291309 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c30191f5-e3c5-4133-baa0-2388fc7a9392 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:51.291765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c30191f5-e3c5-4133-baa0-2388fc7a9392 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:51.292506 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c30191f5-e3c5-4133-baa0-2388fc7a9392 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:51.292939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c30191f5-e3c5-4133-baa0-2388fc7a9392 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:51.375660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-c30191f5-e3c5-4133-baa0-2388fc7a9392 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lazy-loading 'services' on Instance uuid 1d85e129-1f91-4dd5-a330-867543373c26 {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:10:51.652703 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c30191f5-e3c5-4133-baa0-2388fc7a9392 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "DELETE /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments/214b6f97-0696-457f-9c53-1c9232bc2fc2" status: 202 len: 0 microversion: 2.1 time: 0.371854 May 26 17:10:51.653413 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 645/1262] 10.222.0.112 () {58 vars in 1420 bytes} [Thu May 26 17:10:51 2022] DELETE /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments/214b6f97-0696-457f-9c53-1c9232bc2fc2 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:10:51.876903 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0bd2511b-48e7-4585-ae93-23127b414532 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:51.877517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0bd2511b-48e7-4585-ae93-23127b414532 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:51.884014 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0bd2511b-48e7-4585-ae93-23127b414532 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:51.884465 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0bd2511b-48e7-4585-ae93-23127b414532 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:51.885282 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0bd2511b-48e7-4585-ae93-23127b414532 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:51.885717 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0bd2511b-48e7-4585-ae93-23127b414532 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:52.017168 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0bd2511b-48e7-4585-ae93-23127b414532 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:52.024825 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0bd2511b-48e7-4585-ae93-23127b414532 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.151921 May 26 17:10:52.025399 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 618/1263] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:51 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:53.043709 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1cf93636-0d12-42ad-87a6-20875c228c3a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:53.044415 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1cf93636-0d12-42ad-87a6-20875c228c3a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:53.051145 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1cf93636-0d12-42ad-87a6-20875c228c3a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:53.051602 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1cf93636-0d12-42ad-87a6-20875c228c3a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:53.052371 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1cf93636-0d12-42ad-87a6-20875c228c3a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:53.052808 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1cf93636-0d12-42ad-87a6-20875c228c3a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:53.186730 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1cf93636-0d12-42ad-87a6-20875c228c3a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:53.199095 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1cf93636-0d12-42ad-87a6-20875c228c3a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.155388 May 26 17:10:53.199905 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 646/1264] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:53 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:53.870772 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f3935e99-729d-4016-9977-f2df6e3f25df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:53.871706 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f3935e99-729d-4016-9977-f2df6e3f25df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:53.878188 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f3935e99-729d-4016-9977-f2df6e3f25df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:53.878675 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f3935e99-729d-4016-9977-f2df6e3f25df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:53.879440 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f3935e99-729d-4016-9977-f2df6e3f25df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:53.879879 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f3935e99-729d-4016-9977-f2df6e3f25df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:53.911532 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f3935e99-729d-4016-9977-f2df6e3f25df tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044777 May 26 17:10:53.912987 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 619/1265] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:10:53 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:10:54.217647 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7aa4bb3c-2af9-4937-bec8-2b40b938433c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:54.217647 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7aa4bb3c-2af9-4937-bec8-2b40b938433c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:54.224375 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7aa4bb3c-2af9-4937-bec8-2b40b938433c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:54.225502 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7aa4bb3c-2af9-4937-bec8-2b40b938433c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:54.226250 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7aa4bb3c-2af9-4937-bec8-2b40b938433c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:54.226711 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7aa4bb3c-2af9-4937-bec8-2b40b938433c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:54.361221 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7aa4bb3c-2af9-4937-bec8-2b40b938433c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:54.369045 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7aa4bb3c-2af9-4937-bec8-2b40b938433c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.156317 May 26 17:10:54.369618 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 647/1266] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:54 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:54.924249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ab6677cf-eb3d-4d72-ab47-d626f7cfd0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:54.925171 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ab6677cf-eb3d-4d72-ab47-d626f7cfd0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:54.932465 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab6677cf-eb3d-4d72-ab47-d626f7cfd0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:54.932939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab6677cf-eb3d-4d72-ab47-d626f7cfd0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:54.933704 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab6677cf-eb3d-4d72-ab47-d626f7cfd0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:54.934139 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ab6677cf-eb3d-4d72-ab47-d626f7cfd0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:54.964568 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ab6677cf-eb3d-4d72-ab47-d626f7cfd0b1 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044349 May 26 17:10:54.965126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 620/1267] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:10:54 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:10:55.074362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3037fb46-16a2-4b9d-9f65-886aa2d9c1e5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:55.075352 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3037fb46-16a2-4b9d-9f65-886aa2d9c1e5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:55.081751 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3037fb46-16a2-4b9d-9f65-886aa2d9c1e5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:55.086886 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3037fb46-16a2-4b9d-9f65-886aa2d9c1e5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:55.086886 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3037fb46-16a2-4b9d-9f65-886aa2d9c1e5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:55.086886 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3037fb46-16a2-4b9d-9f65-886aa2d9c1e5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:55.114107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3037fb46-16a2-4b9d-9f65-886aa2d9c1e5 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043850 May 26 17:10:55.117146 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 648/1268] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:10:55 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:10:55.176911 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a33f2a19-cee2-4b9e-be99-963ebd5be34e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:55.176911 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a33f2a19-cee2-4b9e-be99-963ebd5be34e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:55.182385 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a33f2a19-cee2-4b9e-be99-963ebd5be34e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:55.182839 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a33f2a19-cee2-4b9e-be99-963ebd5be34e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:55.183605 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a33f2a19-cee2-4b9e-be99-963ebd5be34e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:55.184043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a33f2a19-cee2-4b9e-be99-963ebd5be34e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:55.202537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:55.214849 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a33f2a19-cee2-4b9e-be99-963ebd5be34e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Going to try to terminate instance {{(pid=130525) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:10:55.385871 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f7db87d2-3da3-41a5-b283-e961fd86c1ef tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:55.386516 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f7db87d2-3da3-41a5-b283-e961fd86c1ef tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:55.392818 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f7db87d2-3da3-41a5-b283-e961fd86c1ef tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:55.395027 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f7db87d2-3da3-41a5-b283-e961fd86c1ef tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:55.395027 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f7db87d2-3da3-41a5-b283-e961fd86c1ef tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:55.395027 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f7db87d2-3da3-41a5-b283-e961fd86c1ef tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:55.504963 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a33f2a19-cee2-4b9e-be99-963ebd5be34e tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "DELETE /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 204 len: 0 microversion: 2.1 time: 0.333149 May 26 17:10:55.505655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 621/1269] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:10:55 2022] DELETE /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:10:55.515348 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-dfa2ae2f-db39-43ed-8a7f-907b46d4c689 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:55.516026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-dfa2ae2f-db39-43ed-8a7f-907b46d4c689 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:55.522879 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dfa2ae2f-db39-43ed-8a7f-907b46d4c689 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:55.523442 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dfa2ae2f-db39-43ed-8a7f-907b46d4c689 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:55.524226 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dfa2ae2f-db39-43ed-8a7f-907b46d4c689 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:55.524667 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-dfa2ae2f-db39-43ed-8a7f-907b46d4c689 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:55.533554 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f7db87d2-3da3-41a5-b283-e961fd86c1ef tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:55.541488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f7db87d2-3da3-41a5-b283-e961fd86c1ef tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.160419 May 26 17:10:55.545565 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 649/1270] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:55 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:10:55.664857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-dfa2ae2f-db39-43ed-8a7f-907b46d4c689 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:55.672510 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-dfa2ae2f-db39-43ed-8a7f-907b46d4c689 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1680 microversion: 2.1 time: 0.161251 May 26 17:10:55.673087 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 622/1271] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:55 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:10:56.561689 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-00d8ce69-4bff-4341-b33f-9c0d31c6e9e4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:56.562208 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-00d8ce69-4bff-4341-b33f-9c0d31c6e9e4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:56.568941 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-00d8ce69-4bff-4341-b33f-9c0d31c6e9e4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:56.569466 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-00d8ce69-4bff-4341-b33f-9c0d31c6e9e4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:56.570220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-00d8ce69-4bff-4341-b33f-9c0d31c6e9e4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:56.570672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-00d8ce69-4bff-4341-b33f-9c0d31c6e9e4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:56.691728 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8438cf9e-4a1a-464b-a9bf-5ba2d1f4fd84 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:56.692566 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8438cf9e-4a1a-464b-a9bf-5ba2d1f4fd84 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:56.700608 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-00d8ce69-4bff-4341-b33f-9c0d31c6e9e4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:56.701794 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8438cf9e-4a1a-464b-a9bf-5ba2d1f4fd84 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:56.709791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8438cf9e-4a1a-464b-a9bf-5ba2d1f4fd84 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:56.709791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8438cf9e-4a1a-464b-a9bf-5ba2d1f4fd84 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:56.709791 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8438cf9e-4a1a-464b-a9bf-5ba2d1f4fd84 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:56.710105 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-00d8ce69-4bff-4341-b33f-9c0d31c6e9e4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.151018 May 26 17:10:56.712040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 650/1272] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:56 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:56.837855 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8438cf9e-4a1a-464b-a9bf-5ba2d1f4fd84 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:56.845592 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8438cf9e-4a1a-464b-a9bf-5ba2d1f4fd84 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1680 microversion: 2.1 time: 0.157675 May 26 17:10:56.847057 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 623/1273] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:56 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:10:57.726582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0ad026a3-e770-4664-bdd8-3b430850493e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:57.727187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0ad026a3-e770-4664-bdd8-3b430850493e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:57.733740 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0ad026a3-e770-4664-bdd8-3b430850493e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:57.734185 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0ad026a3-e770-4664-bdd8-3b430850493e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:57.734988 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0ad026a3-e770-4664-bdd8-3b430850493e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:57.735426 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0ad026a3-e770-4664-bdd8-3b430850493e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:57.863658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0da19416-d930-46a1-9038-4e1f1f7d3fbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:57.864587 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0da19416-d930-46a1-9038-4e1f1f7d3fbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:57.884173 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0da19416-d930-46a1-9038-4e1f1f7d3fbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:57.884173 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0da19416-d930-46a1-9038-4e1f1f7d3fbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:57.884434 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0ad026a3-e770-4664-bdd8-3b430850493e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:57.884585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0da19416-d930-46a1-9038-4e1f1f7d3fbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:57.884585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0da19416-d930-46a1-9038-4e1f1f7d3fbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:57.884769 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0ad026a3-e770-4664-bdd8-3b430850493e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.157563 May 26 17:10:57.884769 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 651/1274] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:57 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:58.028404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0da19416-d930-46a1-9038-4e1f1f7d3fbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:58.036094 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0da19416-d930-46a1-9038-4e1f1f7d3fbe tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1680 microversion: 2.1 time: 0.176775 May 26 17:10:58.036666 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 624/1275] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:57 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:10:58.897017 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f688f890-d5bf-49cf-adff-2c2b905a7a60 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:58.897657 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f688f890-d5bf-49cf-adff-2c2b905a7a60 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:58.904186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f688f890-d5bf-49cf-adff-2c2b905a7a60 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:58.904637 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f688f890-d5bf-49cf-adff-2c2b905a7a60 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:58.905403 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f688f890-d5bf-49cf-adff-2c2b905a7a60 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:58.905834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f688f890-d5bf-49cf-adff-2c2b905a7a60 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:59.037352 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f688f890-d5bf-49cf-adff-2c2b905a7a60 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:59.046450 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f688f890-d5bf-49cf-adff-2c2b905a7a60 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1572 microversion: 2.1 time: 0.153201 May 26 17:10:59.053903 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f0a792ca-239f-400a-9f6d-5c880264ec5c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:59.054709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f0a792ca-239f-400a-9f6d-5c880264ec5c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:59.058062 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 652/1276] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:58 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:59.062195 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f0a792ca-239f-400a-9f6d-5c880264ec5c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:59.062829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f0a792ca-239f-400a-9f6d-5c880264ec5c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:59.063867 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f0a792ca-239f-400a-9f6d-5c880264ec5c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:59.064250 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f0a792ca-239f-400a-9f6d-5c880264ec5c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:59.065278 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-de8df278-39bb-4fb2-9c92-d1a2ba7dada4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:10:59.065865 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-de8df278-39bb-4fb2-9c92-d1a2ba7dada4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:59.073149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-de8df278-39bb-4fb2-9c92-d1a2ba7dada4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:59.073605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-de8df278-39bb-4fb2-9c92-d1a2ba7dada4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:59.074508 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-de8df278-39bb-4fb2-9c92-d1a2ba7dada4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:59.074893 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-de8df278-39bb-4fb2-9c92-d1a2ba7dada4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:59.227087 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f0a792ca-239f-400a-9f6d-5c880264ec5c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:59.234728 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f0a792ca-239f-400a-9f6d-5c880264ec5c tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1680 microversion: 2.1 time: 0.185604 May 26 17:10:59.235298 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 625/1277] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:59 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:10:59.514488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-de8df278-39bb-4fb2-9c92-d1a2ba7dada4 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "POST /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a/action" status: 202 len: 0 microversion: 2.1 time: 0.454339 May 26 17:10:59.515362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 653/1278] 10.222.0.112 () {60 vars in 1282 bytes} [Thu May 26 17:10:59 2022] POST /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:10:59.524506 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a379a710-208f-4a64-8dcd-67f9b49c5a7a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:10:59.525131 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a379a710-208f-4a64-8dcd-67f9b49c5a7a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:10:59.531298 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a379a710-208f-4a64-8dcd-67f9b49c5a7a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:59.531958 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a379a710-208f-4a64-8dcd-67f9b49c5a7a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:59.532899 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a379a710-208f-4a64-8dcd-67f9b49c5a7a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:59.533342 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a379a710-208f-4a64-8dcd-67f9b49c5a7a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:59.754244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a379a710-208f-4a64-8dcd-67f9b49c5a7a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:10:59.764910 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a379a710-208f-4a64-8dcd-67f9b49c5a7a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1520 microversion: 2.1 time: 0.245028 May 26 17:10:59.765818 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 626/1279] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:10:59 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:10:59.850838 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-4c8e5eaa-9e40-4276-9d39-5ec9fd97da31 req-446fb302-f706-4ea8-951a-c808134a2d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d85e129-1f91-4dd5-a330-867543373c26", "name": "network-vif-deleted", "tag": "5cf74066-ff82-453f-8a5c-8af488ca071d"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:10:59.861488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-4c8e5eaa-9e40-4276-9d39-5ec9fd97da31 req-446fb302-f706-4ea8-951a-c808134a2d94 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:10:59.862032 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-4c8e5eaa-9e40-4276-9d39-5ec9fd97da31 req-446fb302-f706-4ea8-951a-c808134a2d94 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:10:59.875947 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-4c8e5eaa-9e40-4276-9d39-5ec9fd97da31 req-446fb302-f706-4ea8-951a-c808134a2d94 service nova] Creating event network-vif-deleted:5cf74066-ff82-453f-8a5c-8af488ca071d for instance 1d85e129-1f91-4dd5-a330-867543373c26 on hv-cinder-83607 May 26 17:10:59.883350 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-4c8e5eaa-9e40-4276-9d39-5ec9fd97da31 req-446fb302-f706-4ea8-951a-c808134a2d94 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152307 May 26 17:10:59.884410 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 654/1280] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:00.228381 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-77ff95c3-2337-43d0-98f8-2b123d7a1c98 req-03ce7744-755e-4af4-9166-50e007db3cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e658131-bdbf-45c9-ade8-47d384a77f9a", "name": "network-vif-unplugged", "status": "completed", "tag": "d0ed49f3-1a6a-48c4-be97-4787d5d53277"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:11:00.238066 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-77ff95c3-2337-43d0-98f8-2b123d7a1c98 req-03ce7744-755e-4af4-9166-50e007db3cd4 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:00.238929 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-77ff95c3-2337-43d0-98f8-2b123d7a1c98 req-03ce7744-755e-4af4-9166-50e007db3cd4 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:00.253547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-afa3baff-b3d3-44c0-a1e7-5c3ba20654be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:00.254513 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-afa3baff-b3d3-44c0-a1e7-5c3ba20654be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:00.257474 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.compute.server_external_events [req-77ff95c3-2337-43d0-98f8-2b123d7a1c98 req-03ce7744-755e-4af4-9166-50e007db3cd4 service nova] Unable to find a host for instance 5e658131-bdbf-45c9-ade8-47d384a77f9a. Dropping event network-vif-unplugged {{(pid=130525) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 17:11:00.258655 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-77ff95c3-2337-43d0-98f8-2b123d7a1c98 req-03ce7744-755e-4af4-9166-50e007db3cd4 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035405 May 26 17:11:00.259523 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 627/1281] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 17:11:00.268333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-afa3baff-b3d3-44c0-a1e7-5c3ba20654be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:00.268333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-afa3baff-b3d3-44c0-a1e7-5c3ba20654be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:00.268333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-afa3baff-b3d3-44c0-a1e7-5c3ba20654be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:00.269721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-afa3baff-b3d3-44c0-a1e7-5c3ba20654be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:00.305532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-afa3baff-b3d3-44c0-a1e7-5c3ba20654be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:00.305980 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-afa3baff-b3d3-44c0-a1e7-5c3ba20654be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:00.306469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-afa3baff-b3d3-44c0-a1e7-5c3ba20654be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lazy-loading 'fault' on Instance uuid 1d85e129-1f91-4dd5-a330-867543373c26 {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:11:00.349635 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-afa3baff-b3d3-44c0-a1e7-5c3ba20654be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8207acca876a4af5ac75dd4283916763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f18b754d17d4ded958a80cf2781c72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:00.352871 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:00.358818 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-afa3baff-b3d3-44c0-a1e7-5c3ba20654be tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 200 len: 1332 microversion: 2.1 time: 0.109350 May 26 17:11:00.359861 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 655/1282] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:00 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:11:00.782764 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-37e95c38-3e38-4068-b580-60d9cf757a8c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:00.783407 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-37e95c38-3e38-4068-b580-60d9cf757a8c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:00.789643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-37e95c38-3e38-4068-b580-60d9cf757a8c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:00.790092 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-37e95c38-3e38-4068-b580-60d9cf757a8c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:00.790895 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-37e95c38-3e38-4068-b580-60d9cf757a8c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:00.791335 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-37e95c38-3e38-4068-b580-60d9cf757a8c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:00.938028 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-37e95c38-3e38-4068-b580-60d9cf757a8c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:00.947345 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-37e95c38-3e38-4068-b580-60d9cf757a8c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1520 microversion: 2.1 time: 0.168391 May 26 17:11:00.947946 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 628/1283] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:00 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:01.376382 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-59a9c4c6-74b6-4926-9d29-757ea9c61272 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:01.376991 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-59a9c4c6-74b6-4926-9d29-757ea9c61272 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:01.384629 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-59a9c4c6-74b6-4926-9d29-757ea9c61272 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:01.385081 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-59a9c4c6-74b6-4926-9d29-757ea9c61272 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:01.385843 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-59a9c4c6-74b6-4926-9d29-757ea9c61272 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:01.386274 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-59a9c4c6-74b6-4926-9d29-757ea9c61272 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:01.399955 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-59a9c4c6-74b6-4926-9d29-757ea9c61272 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] HTTP exception thrown: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-59a9c4c6-74b6-4926-9d29-757ea9c61272 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Request method failure captured: May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 HTTP/1.1 May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GZviX4DkdfWz4xoNgrtRiWRKzw7RwHjmE1gO7uIlWyLS6FMbx1Wacl4so40DlpW4w-gblHOt9z4q0yId67L-PNhCAl3C-ocsC6fHXne_Woblkcmcleov13ASLOQoatRpsp1vZqDzW3Ar6kwUtXLnZEQvD2JSr9JHqtOGD9VR8OAgU May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 6f18b754d17d4ded958a80cf2781c72b May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:11:01.401591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:11:01.403344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_6f18b754d17d4ded958a80cf2781c72b"}]}] May 26 17:11:01.403344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:01.403344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 6f18b754d17d4ded958a80cf2781c72b May 26 17:11:01.403344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:01.403344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeTestJSON-160059384-project May 26 17:11:01.403344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:11:01.403344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:11:01.403344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 8207acca876a4af5ac75dd4283916763 May 26 17:11:01.403344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeTestJSON-160059384-project May 26 17:11:01.403344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:11:01.403344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:01.403344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '1d85e129-1f91-4dd5-a330-867543373c26'} May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:01.404201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:01.405855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:01.407272 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-59a9c4c6-74b6-4926-9d29-757ea9c61272 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Returning 404 to user: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:01.407272 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-59a9c4c6-74b6-4926-9d29-757ea9c61272 tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 404 len: 111 microversion: 2.1 time: 0.030519 May 26 17:11:01.407272 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 656/1284] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:01 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:01.411897 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-af6d910d-10f7-46fe-b48a-1f1a5aac139d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '.version_select at 0x7fd25139ed30>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:01.491732 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-af6d910d-10f7-46fe-b48a-1f1a5aac139d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911840862" status: 202 len: 0 microversion: 2.1 time: 0.083006 May 26 17:11:01.492225 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 629/1285] 10.222.0.112 () {58 vars in 1225 bytes} [Thu May 26 17:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911840862 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:11:01.967660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e5783ac9-bebf-453c-b667-8ff0193fd7ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:01.969114 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e5783ac9-bebf-453c-b667-8ff0193fd7ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:01.976895 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e5783ac9-bebf-453c-b667-8ff0193fd7ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:01.977344 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e5783ac9-bebf-453c-b667-8ff0193fd7ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:01.978200 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e5783ac9-bebf-453c-b667-8ff0193fd7ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:01.978664 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e5783ac9-bebf-453c-b667-8ff0193fd7ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:02.120820 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e5783ac9-bebf-453c-b667-8ff0193fd7ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:02.128343 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e5783ac9-bebf-453c-b667-8ff0193fd7ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1522 microversion: 2.1 time: 0.166080 May 26 17:11:02.128901 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 657/1286] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:01 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:03.147716 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-21d5691f-e040-4289-a582-d65231f7e87f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:03.148420 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-21d5691f-e040-4289-a582-d65231f7e87f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:03.157072 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-21d5691f-e040-4289-a582-d65231f7e87f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:03.192865 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-21d5691f-e040-4289-a582-d65231f7e87f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:03.192865 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-21d5691f-e040-4289-a582-d65231f7e87f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:03.192865 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-21d5691f-e040-4289-a582-d65231f7e87f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:03.299577 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-21d5691f-e040-4289-a582-d65231f7e87f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:03.307066 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-21d5691f-e040-4289-a582-d65231f7e87f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.164933 May 26 17:11:03.307624 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 630/1287] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:03 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:04.324971 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-17054fae-2a47-425a-bbcb-7493cb67ba9d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:04.325719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-17054fae-2a47-425a-bbcb-7493cb67ba9d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:04.333166 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17054fae-2a47-425a-bbcb-7493cb67ba9d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:04.333617 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17054fae-2a47-425a-bbcb-7493cb67ba9d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:04.335003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17054fae-2a47-425a-bbcb-7493cb67ba9d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:04.335448 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-17054fae-2a47-425a-bbcb-7493cb67ba9d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:04.472221 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-17054fae-2a47-425a-bbcb-7493cb67ba9d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:04.480067 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-17054fae-2a47-425a-bbcb-7493cb67ba9d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.159020 May 26 17:11:04.487081 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 658/1288] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:04 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:04.883767 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-abceb167-4c00-4c34-8d1b-3cd13c2245aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:04.884596 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-abceb167-4c00-4c34-8d1b-3cd13c2245aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:04.890919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-abceb167-4c00-4c34-8d1b-3cd13c2245aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:04.891365 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-abceb167-4c00-4c34-8d1b-3cd13c2245aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:04.892124 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-abceb167-4c00-4c34-8d1b-3cd13c2245aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:04.892559 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-abceb167-4c00-4c34-8d1b-3cd13c2245aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:04.906388 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-abceb167-4c00-4c34-8d1b-3cd13c2245aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] HTTP exception thrown: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-abceb167-4c00-4c34-8d1b-3cd13c2245aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Request method failure captured: May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: DELETE /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 HTTP/1.1 May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7GZviX4DkdfWz4xoNgrtRiWRKzw7RwHjmE1gO7uIlWyLS6FMbx1Wacl4so40DlpW4w-gblHOt9z4q0yId67L-PNhCAl3C-ocsC6fHXne_Woblkcmcleov13ASLOQoatRpsp1vZqDzW3Ar6kwUtXLnZEQvD2JSr9JHqtOGD9VR8OAgU May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 6f18b754d17d4ded958a80cf2781c72b May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:11:04.908043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:11:04.909707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_6f18b754d17d4ded958a80cf2781c72b"}]}] May 26 17:11:04.909707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:04.909707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 6f18b754d17d4ded958a80cf2781c72b May 26 17:11:04.909707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:04.909707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-AttachVolumeTestJSON-160059384-project May 26 17:11:04.909707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:11:04.909707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:11:04.909707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 8207acca876a4af5ac75dd4283916763 May 26 17:11:04.909707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-AttachVolumeTestJSON-160059384-project May 26 17:11:04.909707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:11:04.909707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:04.909707 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': '1d85e129-1f91-4dd5-a330-867543373c26'} May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:04.910876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:04.912266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:04.914235 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-abceb167-4c00-4c34-8d1b-3cd13c2245aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Returning 404 to user: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:04.914235 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-abceb167-4c00-4c34-8d1b-3cd13c2245aa tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "DELETE /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 404 len: 111 microversion: 2.1 time: 0.030800 May 26 17:11:04.914235 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 631/1289] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:11:04 2022] DELETE /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:04.918131 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-725293cb-d167-4536-a9bc-3644d236170a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:04.918770 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-725293cb-d167-4536-a9bc-3644d236170a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: 1d85e129-1f91-4dd5-a330-867543373c26] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:04.924880 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-725293cb-d167-4536-a9bc-3644d236170a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:04.925353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-725293cb-d167-4536-a9bc-3644d236170a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:04.926102 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-725293cb-d167-4536-a9bc-3644d236170a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:04.926575 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-725293cb-d167-4536-a9bc-3644d236170a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:04.940434 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-725293cb-d167-4536-a9bc-3644d236170a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] HTTP exception thrown: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-725293cb-d167-4536-a9bc-3644d236170a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Request method failure captured: May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 HTTP/1.1 May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GZviX4DkdfWz4xoNgrtRiWRKzw7RwHjmE1gO7uIlWyLS6FMbx1Wacl4so40DlpW4w-gblHOt9z4q0yId67L-PNhCAl3C-ocsC6fHXne_Woblkcmcleov13ASLOQoatRpsp1vZqDzW3Ar6kwUtXLnZEQvD2JSr9JHqtOGD9VR8OAgU May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 6f18b754d17d4ded958a80cf2781c72b May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:11:04.942026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:11:04.944417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_6f18b754d17d4ded958a80cf2781c72b"}]}] May 26 17:11:04.944417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:04.944417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 6f18b754d17d4ded958a80cf2781c72b May 26 17:11:04.944417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:04.944417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeTestJSON-160059384-project May 26 17:11:04.944417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:11:04.944417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:11:04.944417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 8207acca876a4af5ac75dd4283916763 May 26 17:11:04.944417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeTestJSON-160059384-project May 26 17:11:04.944417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:11:04.944417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:04.944417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '1d85e129-1f91-4dd5-a330-867543373c26'} May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:04.945571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. May 26 17:11:04.947302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:04.948833 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-725293cb-d167-4536-a9bc-3644d236170a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Returning 404 to user: Instance 1d85e129-1f91-4dd5-a330-867543373c26 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:04.948833 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-725293cb-d167-4536-a9bc-3644d236170a tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26" status: 404 len: 111 microversion: 2.1 time: 0.029190 May 26 17:11:04.948833 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 659/1290] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:04 2022] GET /compute/v2.1/servers/1d85e129-1f91-4dd5-a330-867543373c26 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:11:05.497324 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8bd9f759-b616-43c3-a7d9-4ce6f7d903a8 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:05.497915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8bd9f759-b616-43c3-a7d9-4ce6f7d903a8 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:05.504225 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8bd9f759-b616-43c3-a7d9-4ce6f7d903a8 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:05.504672 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8bd9f759-b616-43c3-a7d9-4ce6f7d903a8 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:05.505434 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8bd9f759-b616-43c3-a7d9-4ce6f7d903a8 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:05.505864 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8bd9f759-b616-43c3-a7d9-4ce6f7d903a8 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:05.634761 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8bd9f759-b616-43c3-a7d9-4ce6f7d903a8 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:05.642182 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8bd9f759-b616-43c3-a7d9-4ce6f7d903a8 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.148750 May 26 17:11:05.642769 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 632/1291] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:05 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:06.234849 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d00fd91b-61d2-4d28-a3f3-f0466475a66d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:06.235338 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d00fd91b-61d2-4d28-a3f3-f0466475a66d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:06.242310 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d00fd91b-61d2-4d28-a3f3-f0466475a66d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:06.242775 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d00fd91b-61d2-4d28-a3f3-f0466475a66d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:06.243528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d00fd91b-61d2-4d28-a3f3-f0466475a66d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:06.243955 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d00fd91b-61d2-4d28-a3f3-f0466475a66d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:06.257946 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-d00fd91b-61d2-4d28-a3f3-f0466475a66d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] HTTP exception thrown: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d00fd91b-61d2-4d28-a3f3-f0466475a66d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Request method failure captured: May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: DELETE /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb HTTP/1.1 May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GZviX4DkdfWz4xoNgrtRiWRKzw7RwHjmE1gO7uIlWyLS6FMbx1Wacl4so40DlpW4w-gblHOt9z4q0yId67L-PNhCAl3C-ocsC6fHXne_Woblkcmcleov13ASLOQoatRpsp1vZqDzW3Ar6kwUtXLnZEQvD2JSr9JHqtOGD9VR8OAgU May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 6f18b754d17d4ded958a80cf2781c72b May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:11:06.262396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:11:06.264025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_6f18b754d17d4ded958a80cf2781c72b"}]}] May 26 17:11:06.264025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:06.264025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 6f18b754d17d4ded958a80cf2781c72b May 26 17:11:06.264025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:06.264025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeTestJSON-160059384-project May 26 17:11:06.264025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:11:06.264025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:11:06.264025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 8207acca876a4af5ac75dd4283916763 May 26 17:11:06.264025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeTestJSON-160059384-project May 26 17:11:06.264025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:11:06.264025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:11:06.264025 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'a551b1e0-dd51-440e-bf6f-b0600939ddeb'} May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:06.264884 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:11:06.266377 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:06.267918 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d00fd91b-61d2-4d28-a3f3-f0466475a66d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Returning 404 to user: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:06.267918 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d00fd91b-61d2-4d28-a3f3-f0466475a66d tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "DELETE /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 404 len: 111 microversion: 2.1 time: 0.029966 May 26 17:11:06.267918 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 660/1292] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:11:06 2022] DELETE /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:06.269915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7c00fdbc-07d2-4cbc-9a1b-6316eb6473ed tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:06.270622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-7c00fdbc-07d2-4cbc-9a1b-6316eb6473ed tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] [instance: a551b1e0-dd51-440e-bf6f-b0600939ddeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:06.273166 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:06.277996 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7c00fdbc-07d2-4cbc-9a1b-6316eb6473ed tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:06.278582 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7c00fdbc-07d2-4cbc-9a1b-6316eb6473ed tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:06.279517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7c00fdbc-07d2-4cbc-9a1b-6316eb6473ed tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:06.279964 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-7c00fdbc-07d2-4cbc-9a1b-6316eb6473ed tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:06.293500 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-7c00fdbc-07d2-4cbc-9a1b-6316eb6473ed tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] HTTP exception thrown: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7c00fdbc-07d2-4cbc-9a1b-6316eb6473ed tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Request method failure captured: May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb HTTP/1.1 May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7GZviX4DkdfWz4xoNgrtRiWRKzw7RwHjmE1gO7uIlWyLS6FMbx1Wacl4so40DlpW4w-gblHOt9z4q0yId67L-PNhCAl3C-ocsC6fHXne_Woblkcmcleov13ASLOQoatRpsp1vZqDzW3Ar6kwUtXLnZEQvD2JSr9JHqtOGD9VR8OAgU May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 6f18b754d17d4ded958a80cf2781c72b May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:11:06.296527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:11:06.299081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/6f18b754d17d4ded958a80cf2781c72b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_6f18b754d17d4ded958a80cf2781c72b"}]}] May 26 17:11:06.299081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:06.299081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 6f18b754d17d4ded958a80cf2781c72b May 26 17:11:06.299081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-AttachVolumeTestJSON-160059384 May 26 17:11:06.299081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-AttachVolumeTestJSON-160059384-project May 26 17:11:06.299081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:11:06.299081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:11:06.299081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 8207acca876a4af5ac75dd4283916763 May 26 17:11:06.299081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-AttachVolumeTestJSON-160059384-project May 26 17:11:06.299081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:11:06.299081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:11:06.299081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': 'a551b1e0-dd51-440e-bf6f-b0600939ddeb'} May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:06.300521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. May 26 17:11:06.303354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:06.306451 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7c00fdbc-07d2-4cbc-9a1b-6316eb6473ed tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] Returning 404 to user: Instance a551b1e0-dd51-440e-bf6f-b0600939ddeb could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:06.306451 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7c00fdbc-07d2-4cbc-9a1b-6316eb6473ed tempest-AttachVolumeTestJSON-160059384 tempest-AttachVolumeTestJSON-160059384-project] 10.222.0.112 "GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb" status: 404 len: 111 microversion: 2.1 time: 0.030639 May 26 17:11:06.306451 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 633/1293] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:06 2022] GET /compute/v2.1/servers/a551b1e0-dd51-440e-bf6f-b0600939ddeb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:06.660079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-25eb1c39-097e-47c6-9955-c0110d5ce27e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:06.660718 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-25eb1c39-097e-47c6-9955-c0110d5ce27e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:06.662646 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=57 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:06.668206 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-25eb1c39-097e-47c6-9955-c0110d5ce27e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:06.668652 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-25eb1c39-097e-47c6-9955-c0110d5ce27e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:06.669411 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-25eb1c39-097e-47c6-9955-c0110d5ce27e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:06.669845 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-25eb1c39-097e-47c6-9955-c0110d5ce27e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:06.950533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-25eb1c39-097e-47c6-9955-c0110d5ce27e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:06.958469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-25eb1c39-097e-47c6-9955-c0110d5ce27e tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.302175 May 26 17:11:06.968447 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 661/1294] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:06 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:07.975808 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-00ba32fc-3675-4d37-badc-b85aa97acaab tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:07.976452 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-00ba32fc-3675-4d37-badc-b85aa97acaab tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:07.983423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-00ba32fc-3675-4d37-badc-b85aa97acaab tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:07.983874 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-00ba32fc-3675-4d37-badc-b85aa97acaab tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:07.984637 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-00ba32fc-3675-4d37-badc-b85aa97acaab tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:07.985072 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-00ba32fc-3675-4d37-badc-b85aa97acaab tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:08.141100 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-00ba32fc-3675-4d37-badc-b85aa97acaab tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:08.150345 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-00ba32fc-3675-4d37-badc-b85aa97acaab tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.178707 May 26 17:11:08.150916 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 634/1295] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:07 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:09.167422 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d366a83e-8743-4958-a87a-4865c08d0d02 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:09.168039 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d366a83e-8743-4958-a87a-4865c08d0d02 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:09.175013 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d366a83e-8743-4958-a87a-4865c08d0d02 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:09.175459 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d366a83e-8743-4958-a87a-4865c08d0d02 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:09.176248 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d366a83e-8743-4958-a87a-4865c08d0d02 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:09.176675 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d366a83e-8743-4958-a87a-4865c08d0d02 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:09.305969 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d366a83e-8743-4958-a87a-4865c08d0d02 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:09.315111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d366a83e-8743-4958-a87a-4865c08d0d02 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.151468 May 26 17:11:09.318249 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 662/1296] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:09 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:10.334631 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-144bde83-657a-4b92-9233-02b99143c509 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:10.335815 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-144bde83-657a-4b92-9233-02b99143c509 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:10.341745 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-144bde83-657a-4b92-9233-02b99143c509 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:10.342193 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-144bde83-657a-4b92-9233-02b99143c509 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:10.343067 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-144bde83-657a-4b92-9233-02b99143c509 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:10.343500 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-144bde83-657a-4b92-9233-02b99143c509 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:10.482385 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-144bde83-657a-4b92-9233-02b99143c509 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:10.490043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-144bde83-657a-4b92-9233-02b99143c509 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.159685 May 26 17:11:10.490647 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 635/1297] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:10 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:11.508308 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-35458df1-a864-4a8c-bc19-7b6262932ab9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:11.508887 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-35458df1-a864-4a8c-bc19-7b6262932ab9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:11.515422 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-35458df1-a864-4a8c-bc19-7b6262932ab9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:11.515874 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-35458df1-a864-4a8c-bc19-7b6262932ab9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:11.516637 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-35458df1-a864-4a8c-bc19-7b6262932ab9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:11.517077 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-35458df1-a864-4a8c-bc19-7b6262932ab9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:11.654799 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-35458df1-a864-4a8c-bc19-7b6262932ab9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:11.662399 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-35458df1-a864-4a8c-bc19-7b6262932ab9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.159081 May 26 17:11:11.663221 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 663/1298] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:11 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:12.091584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3d25ffa4-e670-490c-9caa-c3054643f4a1 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Action: 'create', calling method: .version_select at 0x7fd250ff5790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-76863065", "metadata": {"Type": "work"}}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3d25ffa4-e670-490c-9caa-c3054643f4a1 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Request method failure captured: May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 120 May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7Svmtwy1dRMfSoU5FfHNIzCkSBVR8zh1xxRAq3RNBAvk80A6YdbnWI53cdwE_WkQlldAPSKc6N1lwJYE212BD046yn4pfSnJe-sjVoJltN4RQ7O5sUkj6oOGXjKC6VLFKtZpseDeARi0aQ-ulgO_jz6poulHMfsqw24YXFJyPSMv2g May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 1abc0bcaa5bf4121a02f9e3bc6910804 May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:11:12.103875 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_1abc0bcaa5bf4121a02f9e3bc6910804"}]}] May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 1abc0bcaa5bf4121a02f9e3bc6910804 May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-VolumesNegativeTest-1489704612-project May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: b3c4ff8c0eca413fbe709169475c1498 May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-VolumesNegativeTest-1489704612-project May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-76863065", "metadata": {"Type": "work"}}} May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: May 26 17:11:12.105501 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-76863065', 'metadata': {'Type': 'work'}}}} May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise error May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi '#$%' May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:12.106758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 17:11:12.108427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 17:11:12.109947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 17:11:12.109947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.109947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3d25ffa4-e670-490c-9caa-c3054643f4a1 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:12.109947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3d25ffa4-e670-490c-9caa-c3054643f4a1 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] 10.222.0.112 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.130826 May 26 17:11:12.109947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 636/1299] 10.222.0.112 () {60 vars in 1160 bytes} [Thu May 26 17:11:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 17:11:12.115341 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-717a274b-b13a-4360-8614-9b2a62cf3586 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Action: 'create', calling method: .version_select at 0x7fd2510843a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-42822996", "metadata": {"Type": "work"}}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-717a274b-b13a-4360-8614-9b2a62cf3586 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Request method failure captured: May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 118 May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7Svmtwy1dRMfSoU5FfHNIzCkSBVR8zh1xxRAq3RNBAvk80A6YdbnWI53cdwE_WkQlldAPSKc6N1lwJYE212BD046yn4pfSnJe-sjVoJltN4RQ7O5sUkj6oOGXjKC6VLFKtZpseDeARi0aQ-ulgO_jz6poulHMfsqw24YXFJyPSMv2g May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 1abc0bcaa5bf4121a02f9e3bc6910804 May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:11:12.118920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_1abc0bcaa5bf4121a02f9e3bc6910804"}]}] May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 1abc0bcaa5bf4121a02f9e3bc6910804 May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-VolumesNegativeTest-1489704612-project May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: b3c4ff8c0eca413fbe709169475c1498 May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-VolumesNegativeTest-1489704612-project May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-42822996", "metadata": {"Type": "work"}}} May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: May 26 17:11:12.120493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-42822996', 'metadata': {'Type': 'work'}}}} May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise error May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi '0' May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:12.121669 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 17:11:12.123353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 17:11:12.124850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 17:11:12.124850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.124850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-717a274b-b13a-4360-8614-9b2a62cf3586 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:12.124850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-717a274b-b13a-4360-8614-9b2a62cf3586 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] 10.222.0.112 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008805 May 26 17:11:12.124850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 664/1300] 10.222.0.112 () {60 vars in 1160 bytes} [Thu May 26 17:11:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 17:11:12.128853 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7398234c-450e-4d49-b283-8113ce33cdb8 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Action: 'create', calling method: .version_select at 0x7fd25624b940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-813365212", "metadata": {"Type": "work"}}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7398234c-450e-4d49-b283-8113ce33cdb8 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Request method failure captured: May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 118 May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7Svmtwy1dRMfSoU5FfHNIzCkSBVR8zh1xxRAq3RNBAvk80A6YdbnWI53cdwE_WkQlldAPSKc6N1lwJYE212BD046yn4pfSnJe-sjVoJltN4RQ7O5sUkj6oOGXjKC6VLFKtZpseDeARi0aQ-ulgO_jz6poulHMfsqw24YXFJyPSMv2g May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 1abc0bcaa5bf4121a02f9e3bc6910804 May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:11:12.131184 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_1abc0bcaa5bf4121a02f9e3bc6910804"}]}] May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 1abc0bcaa5bf4121a02f9e3bc6910804 May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-VolumesNegativeTest-1489704612-project May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: b3c4ff8c0eca413fbe709169475c1498 May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-VolumesNegativeTest-1489704612-project May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-813365212", "metadata": {"Type": "work"}}} May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: May 26 17:11:12.133234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-813365212', 'metadata': {'Type': 'work'}}}} May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise error May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi '' May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:12.134375 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 17:11:12.136060 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 17:11:12.137560 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 17:11:12.137560 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.137560 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-7398234c-450e-4d49-b283-8113ce33cdb8 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:12.137560 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-7398234c-450e-4d49-b283-8113ce33cdb8 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] 10.222.0.112 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007951 May 26 17:11:12.137560 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 637/1301] 10.222.0.112 () {60 vars in 1160 bytes} [Thu May 26 17:11:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 17:11:12.141968 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1822022b-c5b6-4e60-8f80-4b4c7e167f80 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Calling method '.version_select at 0x7fd250f3bdc0>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:12.170061 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-1822022b-c5b6-4e60-8f80-4b4c7e167f80 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] HTTP exception thrown: Volume tempest-invalid-2015303291 could not be found. May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1822022b-c5b6-4e60-8f80-4b4c7e167f80 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Request method failure captured: May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2015303291 HTTP/1.1 May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7Svmtwy1dRMfSoU5FfHNIzCkSBVR8zh1xxRAq3RNBAvk80A6YdbnWI53cdwE_WkQlldAPSKc6N1lwJYE212BD046yn4pfSnJe-sjVoJltN4RQ7O5sUkj6oOGXjKC6VLFKtZpseDeARi0aQ-ulgO_jz6poulHMfsqw24YXFJyPSMv2g May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 1abc0bcaa5bf4121a02f9e3bc6910804 May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:11:12.176444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_1abc0bcaa5bf4121a02f9e3bc6910804"}]}] May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 1abc0bcaa5bf4121a02f9e3bc6910804 May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-VolumesNegativeTest-1489704612-project May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: b3c4ff8c0eca413fbe709169475c1498 May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-VolumesNegativeTest-1489704612-project May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Volume tempest-invalid-2015303291 could not be found. May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'tempest-invalid-2015303291'} May 26 17:11:12.178120 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2015303291 could not be found. (HTTP 404) (Request-ID: req-04068a97-978b-4d53-9754-685f63fc86b9) May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.179585 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 17:11:12.181107 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2015303291 could not be found. May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:12.183239 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2015303291 could not be found. May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2015303291 could not be found. May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1822022b-c5b6-4e60-8f80-4b4c7e167f80 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Returning 404 to user: Volume tempest-invalid-2015303291 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1822022b-c5b6-4e60-8f80-4b4c7e167f80 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] 10.222.0.112 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2015303291" status: 404 len: 99 microversion: 2.1 time: 0.039664 May 26 17:11:12.184750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 665/1302] 10.222.0.112 () {58 vars in 1222 bytes} [Thu May 26 17:11:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2015303291 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 17:11:12.189422 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-60243ed0-ebc7-451b-93e5-1f389a8aab2c tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] 10.222.0.112 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003926 May 26 17:11:12.189980 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 638/1303] 10.222.0.112 () {58 vars in 1144 bytes} [Thu May 26 17:11:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 17:11:12.199289 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-170a0389-04ea-4fb3-8e83-176e0a0c84e3 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003765 May 26 17:11:12.199791 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 666/1304] 10.222.0.112 () {58 vars in 1141 bytes} [Thu May 26 17:11:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 17:11:12.208561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9111957e-8a0c-435c-96d3-f3c74c8961b1 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Calling method '.version_select at 0x7fd251209310>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:12.236255 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-9111957e-8a0c-435c-96d3-f3c74c8961b1 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] HTTP exception thrown: Volume c814d3d7-f45a-4b04-87a9-b221f505e085 could not be found. May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9111957e-8a0c-435c-96d3-f3c74c8961b1 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Request method failure captured: May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: DELETE /compute/v2.1/os-volumes/c814d3d7-f45a-4b04-87a9-b221f505e085 HTTP/1.1 May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7Svmtwy1dRMfSoU5FfHNIzCkSBVR8zh1xxRAq3RNBAvk80A6YdbnWI53cdwE_WkQlldAPSKc6N1lwJYE212BD046yn4pfSnJe-sjVoJltN4RQ7O5sUkj6oOGXjKC6VLFKtZpseDeARi0aQ-ulgO_jz6poulHMfsqw24YXFJyPSMv2g May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 1abc0bcaa5bf4121a02f9e3bc6910804 May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:11:12.239626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_1abc0bcaa5bf4121a02f9e3bc6910804"}]}] May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 1abc0bcaa5bf4121a02f9e3bc6910804 May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-VolumesNegativeTest-1489704612-project May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: b3c4ff8c0eca413fbe709169475c1498 May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-VolumesNegativeTest-1489704612-project May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Volume c814d3d7-f45a-4b04-87a9-b221f505e085 could not be found. May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': 'c814d3d7-f45a-4b04-87a9-b221f505e085'} May 26 17:11:12.241743 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c814d3d7-f45a-4b04-87a9-b221f505e085 could not be found. (HTTP 404) (Request-ID: req-c69464b2-8d00-44b6-a49f-56963abb8079) May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.242799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 17:11:12.244183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c814d3d7-f45a-4b04-87a9-b221f505e085 could not be found. May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 17:11:12.245444 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c814d3d7-f45a-4b04-87a9-b221f505e085 could not be found. May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c814d3d7-f45a-4b04-87a9-b221f505e085 could not be found. May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9111957e-8a0c-435c-96d3-f3c74c8961b1 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Returning 404 to user: Volume c814d3d7-f45a-4b04-87a9-b221f505e085 could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9111957e-8a0c-435c-96d3-f3c74c8961b1 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] 10.222.0.112 "DELETE /compute/v2.1/os-volumes/c814d3d7-f45a-4b04-87a9-b221f505e085" status: 404 len: 109 microversion: 2.1 time: 0.036543 May 26 17:11:12.246876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 639/1305] 10.222.0.112 () {58 vars in 1252 bytes} [Thu May 26 17:11:12 2022] DELETE /compute/v2.1/os-volumes/c814d3d7-f45a-4b04-87a9-b221f505e085 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:12.252097 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-128c2d41-ac29-40ab-9e8f-07365d2db544 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Calling method '.version_select at 0x7fd250db71f0>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:12.279873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-128c2d41-ac29-40ab-9e8f-07365d2db544 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] HTTP exception thrown: Volume e34092ce-ce04-4b6d-a945-7854d6af0f2b could not be found. May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-128c2d41-ac29-40ab-9e8f-07365d2db544 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Request method failure captured: May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/os-volumes/e34092ce-ce04-4b6d-a945-7854d6af0f2b HTTP/1.1 May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7Svmtwy1dRMfSoU5FfHNIzCkSBVR8zh1xxRAq3RNBAvk80A6YdbnWI53cdwE_WkQlldAPSKc6N1lwJYE212BD046yn4pfSnJe-sjVoJltN4RQ7O5sUkj6oOGXjKC6VLFKtZpseDeARi0aQ-ulgO_jz6poulHMfsqw24YXFJyPSMv2g May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 1abc0bcaa5bf4121a02f9e3bc6910804 May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:11:12.282079 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/1abc0bcaa5bf4121a02f9e3bc6910804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_1abc0bcaa5bf4121a02f9e3bc6910804"}]}] May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 1abc0bcaa5bf4121a02f9e3bc6910804 May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-VolumesNegativeTest-1489704612 May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-VolumesNegativeTest-1489704612-project May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: b3c4ff8c0eca413fbe709169475c1498 May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-VolumesNegativeTest-1489704612-project May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Volume e34092ce-ce04-4b6d-a945-7854d6af0f2b could not be found. May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'e34092ce-ce04-4b6d-a945-7854d6af0f2b'} May 26 17:11:12.283727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e34092ce-ce04-4b6d-a945-7854d6af0f2b could not be found. (HTTP 404) (Request-ID: req-411fe1c0-acbb-4442-b3b9-f329438e527e) May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.284759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:11:12.286256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e34092ce-ce04-4b6d-a945-7854d6af0f2b could not be found. May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 17:11:12.287673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e34092ce-ce04-4b6d-a945-7854d6af0f2b could not be found. May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e34092ce-ce04-4b6d-a945-7854d6af0f2b could not be found. May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-128c2d41-ac29-40ab-9e8f-07365d2db544 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] Returning 404 to user: Volume e34092ce-ce04-4b6d-a945-7854d6af0f2b could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-128c2d41-ac29-40ab-9e8f-07365d2db544 tempest-VolumesNegativeTest-1489704612 tempest-VolumesNegativeTest-1489704612-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/e34092ce-ce04-4b6d-a945-7854d6af0f2b" status: 404 len: 109 microversion: 2.1 time: 0.035201 May 26 17:11:12.289192 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 667/1306] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:11:12 2022] GET /compute/v2.1/os-volumes/e34092ce-ce04-4b6d-a945-7854d6af0f2b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:12.679968 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6ec570bc-4e15-4afa-96f6-2d023808627d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:12.680576 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6ec570bc-4e15-4afa-96f6-2d023808627d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:12.688901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6ec570bc-4e15-4afa-96f6-2d023808627d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:12.689349 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6ec570bc-4e15-4afa-96f6-2d023808627d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:12.690121 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6ec570bc-4e15-4afa-96f6-2d023808627d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:12.690581 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6ec570bc-4e15-4afa-96f6-2d023808627d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:12.822618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6ec570bc-4e15-4afa-96f6-2d023808627d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:12.830672 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6ec570bc-4e15-4afa-96f6-2d023808627d tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.155422 May 26 17:11:12.831364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 640/1307] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:12 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:13.848254 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f5fb6694-65dc-4e09-8211-f91aa2044de0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:13.848921 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f5fb6694-65dc-4e09-8211-f91aa2044de0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:13.855672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f5fb6694-65dc-4e09-8211-f91aa2044de0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:13.856116 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f5fb6694-65dc-4e09-8211-f91aa2044de0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:13.856874 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f5fb6694-65dc-4e09-8211-f91aa2044de0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:13.857302 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f5fb6694-65dc-4e09-8211-f91aa2044de0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:13.999854 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f5fb6694-65dc-4e09-8211-f91aa2044de0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:14.008103 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f5fb6694-65dc-4e09-8211-f91aa2044de0 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.164704 May 26 17:11:14.008760 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 668/1308] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:13 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:15.026108 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-492e99c9-ba1b-439c-a616-915920555c9b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:15.026732 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-492e99c9-ba1b-439c-a616-915920555c9b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:15.033286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-492e99c9-ba1b-439c-a616-915920555c9b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:15.033795 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-492e99c9-ba1b-439c-a616-915920555c9b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:15.034590 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-492e99c9-ba1b-439c-a616-915920555c9b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:15.035023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-492e99c9-ba1b-439c-a616-915920555c9b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:15.171755 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-492e99c9-ba1b-439c-a616-915920555c9b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:15.180412 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-492e99c9-ba1b-439c-a616-915920555c9b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.159274 May 26 17:11:15.180991 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 641/1309] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:15 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:15.203021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:11:15.203208 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Thu May 26 17:11:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:11:16.198092 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3a589cbb-9451-4579-96d5-920eef952d8b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:16.199040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3a589cbb-9451-4579-96d5-920eef952d8b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:16.207070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3a589cbb-9451-4579-96d5-920eef952d8b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:16.207661 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3a589cbb-9451-4579-96d5-920eef952d8b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:16.211636 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3a589cbb-9451-4579-96d5-920eef952d8b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:16.211636 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3a589cbb-9451-4579-96d5-920eef952d8b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:16.346354 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3a589cbb-9451-4579-96d5-920eef952d8b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:16.354464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3a589cbb-9451-4579-96d5-920eef952d8b tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.161225 May 26 17:11:16.355023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 669/1310] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:16 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:16.814120 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-a02c3985-7785-4464-a116-bcd75fa435f2 req-832b9406-44b2-48aa-8f67-68010bae163f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e658131-bdbf-45c9-ade8-47d384a77f9a", "name": "network-vif-plugged", "status": "completed", "tag": "d0ed49f3-1a6a-48c4-be97-4787d5d53277"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:11:16.822882 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-a02c3985-7785-4464-a116-bcd75fa435f2 req-832b9406-44b2-48aa-8f67-68010bae163f service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:16.823325 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-a02c3985-7785-4464-a116-bcd75fa435f2 req-832b9406-44b2-48aa-8f67-68010bae163f service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:16.834268 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-a02c3985-7785-4464-a116-bcd75fa435f2 req-832b9406-44b2-48aa-8f67-68010bae163f service nova] Creating event network-vif-plugged:d0ed49f3-1a6a-48c4-be97-4787d5d53277 for instance 5e658131-bdbf-45c9-ade8-47d384a77f9a on hv-cinder-83607 May 26 17:11:16.840428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-a02c3985-7785-4464-a116-bcd75fa435f2 req-832b9406-44b2-48aa-8f67-68010bae163f service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029989 May 26 17:11:16.841028 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 642/1311] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:17.373330 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ea58976d-f59f-4278-8b9a-25374e825af5 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:17.373993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ea58976d-f59f-4278-8b9a-25374e825af5 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:17.381666 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ea58976d-f59f-4278-8b9a-25374e825af5 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:17.382124 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ea58976d-f59f-4278-8b9a-25374e825af5 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:17.383091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ea58976d-f59f-4278-8b9a-25374e825af5 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:17.383528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ea58976d-f59f-4278-8b9a-25374e825af5 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:17.538580 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ea58976d-f59f-4278-8b9a-25374e825af5 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:17.546965 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ea58976d-f59f-4278-8b9a-25374e825af5 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.178345 May 26 17:11:17.547568 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 670/1312] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:17 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:18.565596 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f6253e22-9dfc-4656-9a8e-4f7353676e84 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:18.566198 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f6253e22-9dfc-4656-9a8e-4f7353676e84 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:18.572448 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f6253e22-9dfc-4656-9a8e-4f7353676e84 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:18.572891 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f6253e22-9dfc-4656-9a8e-4f7353676e84 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:18.573704 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f6253e22-9dfc-4656-9a8e-4f7353676e84 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:18.574135 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f6253e22-9dfc-4656-9a8e-4f7353676e84 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:18.709521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f6253e22-9dfc-4656-9a8e-4f7353676e84 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:18.717166 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f6253e22-9dfc-4656-9a8e-4f7353676e84 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1578 microversion: 2.1 time: 0.156488 May 26 17:11:18.717732 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 643/1313] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:18 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:19.306998 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-85fc62c8-374c-48a5-9998-e902d097ca86 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:19.307529 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-85fc62c8-374c-48a5-9998-e902d097ca86 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:19.314035 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-85fc62c8-374c-48a5-9998-e902d097ca86 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:19.314528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-85fc62c8-374c-48a5-9998-e902d097ca86 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:19.315298 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-85fc62c8-374c-48a5-9998-e902d097ca86 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:19.315737 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-85fc62c8-374c-48a5-9998-e902d097ca86 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:19.341046 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-85fc62c8-374c-48a5-9998-e902d097ca86 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/ips" status: 200 len: 149 microversion: 2.1 time: 0.038617 May 26 17:11:19.341627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 671/1314] 10.222.0.112 () {58 vars in 1252 bytes} [Thu May 26 17:11:19 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:19.734809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fc7c1904-1977-4dfd-8dcf-df981252c61f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:19.735611 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fc7c1904-1977-4dfd-8dcf-df981252c61f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:19.746183 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fc7c1904-1977-4dfd-8dcf-df981252c61f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:19.751251 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fc7c1904-1977-4dfd-8dcf-df981252c61f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:19.752133 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fc7c1904-1977-4dfd-8dcf-df981252c61f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:19.752637 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fc7c1904-1977-4dfd-8dcf-df981252c61f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:19.757658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:19.885367 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fc7c1904-1977-4dfd-8dcf-df981252c61f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:19.894909 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fc7c1904-1977-4dfd-8dcf-df981252c61f tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1565 microversion: 2.1 time: 0.161627 May 26 17:11:19.894909 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 644/1315] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:19 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:22.163590 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9a253a5a-693a-45b5-8f99-48ab508e0019 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70e034b2-6efa-411a-a896-9777f17d4a7a"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:11:22.164764 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9a253a5a-693a-45b5-8f99-48ab508e0019 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:22.171186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9a253a5a-693a-45b5-8f99-48ab508e0019 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:22.171640 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9a253a5a-693a-45b5-8f99-48ab508e0019 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:22.172413 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9a253a5a-693a-45b5-8f99-48ab508e0019 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:22.172853 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9a253a5a-693a-45b5-8f99-48ab508e0019 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:23.632713 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9a253a5a-693a-45b5-8f99-48ab508e0019 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "POST /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.473208 May 26 17:11:23.633457 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 672/1316] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:11:22 2022] POST /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/os-volume_attachments => generated 194 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:24.422300 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:11:24.422537 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Thu May 26 17:11:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:11:32.300261 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-70fba65a-8d2d-47b7-a4c6-1537b2fa8eac tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:32.300759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-70fba65a-8d2d-47b7-a4c6-1537b2fa8eac tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:32.303185 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=15 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:32.309109 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-70fba65a-8d2d-47b7-a4c6-1537b2fa8eac tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:32.309563 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-70fba65a-8d2d-47b7-a4c6-1537b2fa8eac tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:32.310343 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-70fba65a-8d2d-47b7-a4c6-1537b2fa8eac tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:32.310793 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-70fba65a-8d2d-47b7-a4c6-1537b2fa8eac tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:32.393011 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-70fba65a-8d2d-47b7-a4c6-1537b2fa8eac tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lazy-loading 'services' on Instance uuid 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:11:32.619520 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-70fba65a-8d2d-47b7-a4c6-1537b2fa8eac tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/os-volume_attachments/70e034b2-6efa-411a-a896-9777f17d4a7a" status: 202 len: 0 microversion: 2.1 time: 0.322784 May 26 17:11:32.620125 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 645/1317] 10.222.0.112 () {58 vars in 1420 bytes} [Thu May 26 17:11:32 2022] DELETE /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/os-volume_attachments/70e034b2-6efa-411a-a896-9777f17d4a7a => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:11:32.626692 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=15 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:32.630958 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-42dd7b68-0268-4fa1-ac9d-f06fdbdd4c7c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:32.632293 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-42dd7b68-0268-4fa1-ac9d-f06fdbdd4c7c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:32.639052 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-42dd7b68-0268-4fa1-ac9d-f06fdbdd4c7c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:32.639497 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-42dd7b68-0268-4fa1-ac9d-f06fdbdd4c7c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:32.640271 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-42dd7b68-0268-4fa1-ac9d-f06fdbdd4c7c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:32.640953 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-42dd7b68-0268-4fa1-ac9d-f06fdbdd4c7c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:32.645235 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:32.670896 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-42dd7b68-0268-4fa1-ac9d-f06fdbdd4c7c tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045844 May 26 17:11:32.671542 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 673/1318] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:11:32 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:33.684767 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6a08be98-c08e-473c-8c66-88ced6b4df4e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:33.685765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6a08be98-c08e-473c-8c66-88ced6b4df4e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:33.692089 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6a08be98-c08e-473c-8c66-88ced6b4df4e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:33.692532 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6a08be98-c08e-473c-8c66-88ced6b4df4e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:33.693294 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6a08be98-c08e-473c-8c66-88ced6b4df4e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:33.693718 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6a08be98-c08e-473c-8c66-88ced6b4df4e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:33.726612 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6a08be98-c08e-473c-8c66-88ced6b4df4e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047358 May 26 17:11:33.727187 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 646/1319] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:11:33 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:34.739251 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f8e6b368-6486-4944-abef-0474eb4ae577 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:34.740208 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f8e6b368-6486-4944-abef-0474eb4ae577 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:34.748024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f8e6b368-6486-4944-abef-0474eb4ae577 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:34.748470 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f8e6b368-6486-4944-abef-0474eb4ae577 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:34.749230 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f8e6b368-6486-4944-abef-0474eb4ae577 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:34.749666 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f8e6b368-6486-4944-abef-0474eb4ae577 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:34.778001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f8e6b368-6486-4944-abef-0474eb4ae577 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043003 May 26 17:11:34.778595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 674/1320] 10.222.0.112 () {58 vars in 1306 bytes} [Thu May 26 17:11:34 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:11:34.843731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ebd5e1c6-30cf-4126-b961-b5bd866c4bdc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:34.844250 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ebd5e1c6-30cf-4126-b961-b5bd866c4bdc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:34.850596 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ebd5e1c6-30cf-4126-b961-b5bd866c4bdc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:34.851035 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ebd5e1c6-30cf-4126-b961-b5bd866c4bdc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:34.851782 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ebd5e1c6-30cf-4126-b961-b5bd866c4bdc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:34.852204 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ebd5e1c6-30cf-4126-b961-b5bd866c4bdc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:34.877712 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ebd5e1c6-30cf-4126-b961-b5bd866c4bdc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Going to try to terminate instance {{(pid=130525) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:11:35.169851 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ebd5e1c6-30cf-4126-b961-b5bd866c4bdc tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 204 len: 0 microversion: 2.1 time: 0.329612 May 26 17:11:35.170471 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 647/1321] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:11:34 2022] DELETE /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:11:35.178920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9f258516-8e38-4be8-8d39-1bda7c7eaffd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:35.179568 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9f258516-8e38-4be8-8d39-1bda7c7eaffd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:35.185839 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9f258516-8e38-4be8-8d39-1bda7c7eaffd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:35.186290 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9f258516-8e38-4be8-8d39-1bda7c7eaffd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:35.187126 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9f258516-8e38-4be8-8d39-1bda7c7eaffd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:35.187559 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9f258516-8e38-4be8-8d39-1bda7c7eaffd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:35.324211 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9f258516-8e38-4be8-8d39-1bda7c7eaffd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:35.332057 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9f258516-8e38-4be8-8d39-1bda7c7eaffd tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1684 microversion: 2.1 time: 0.157318 May 26 17:11:35.334969 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 675/1322] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:35 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:36.350793 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-169c844b-bbba-4bab-b2ae-c2e2443ce931 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:36.351494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-169c844b-bbba-4bab-b2ae-c2e2443ce931 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:36.358602 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-169c844b-bbba-4bab-b2ae-c2e2443ce931 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:36.359051 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-169c844b-bbba-4bab-b2ae-c2e2443ce931 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:36.359823 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-169c844b-bbba-4bab-b2ae-c2e2443ce931 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:36.360252 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-169c844b-bbba-4bab-b2ae-c2e2443ce931 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:36.502032 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-169c844b-bbba-4bab-b2ae-c2e2443ce931 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:36.509593 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-169c844b-bbba-4bab-b2ae-c2e2443ce931 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1684 microversion: 2.1 time: 0.162928 May 26 17:11:36.510297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 648/1323] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:36 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:11:37.527300 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0b42ad39-2702-4285-90c7-23144c2c1835 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:37.527995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0b42ad39-2702-4285-90c7-23144c2c1835 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:37.534499 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0b42ad39-2702-4285-90c7-23144c2c1835 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:37.534944 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0b42ad39-2702-4285-90c7-23144c2c1835 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:37.535696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0b42ad39-2702-4285-90c7-23144c2c1835 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:37.536129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0b42ad39-2702-4285-90c7-23144c2c1835 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:37.667971 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0b42ad39-2702-4285-90c7-23144c2c1835 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:37.675319 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0b42ad39-2702-4285-90c7-23144c2c1835 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1684 microversion: 2.1 time: 0.152177 May 26 17:11:37.676170 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 676/1324] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:37 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:38.693399 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ef38d0f1-96c5-4521-9054-41274469b897 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:38.695739 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ef38d0f1-96c5-4521-9054-41274469b897 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:38.701159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ef38d0f1-96c5-4521-9054-41274469b897 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:38.701603 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ef38d0f1-96c5-4521-9054-41274469b897 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:38.702393 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ef38d0f1-96c5-4521-9054-41274469b897 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:38.702833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ef38d0f1-96c5-4521-9054-41274469b897 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:38.934455 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ef38d0f1-96c5-4521-9054-41274469b897 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:38.941867 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ef38d0f1-96c5-4521-9054-41274469b897 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1684 microversion: 2.1 time: 0.252378 May 26 17:11:38.951960 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 649/1325] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:38 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1684 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:39.713837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-98b3242c-b848-42bb-aac7-43cfef310261 req-9bfc198c-a464-41c8-b760-b07f1624a2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c01d7d7-3fc2-4327-b3e7-f8415b2d323f", "name": "network-vif-deleted", "tag": "9dcd846e-cfa0-472b-9e6d-3b7b0aa8c2c9"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:11:39.722593 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-98b3242c-b848-42bb-aac7-43cfef310261 req-9bfc198c-a464-41c8-b760-b07f1624a2cc service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:39.727346 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-98b3242c-b848-42bb-aac7-43cfef310261 req-9bfc198c-a464-41c8-b760-b07f1624a2cc service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:39.735342 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-98b3242c-b848-42bb-aac7-43cfef310261 req-9bfc198c-a464-41c8-b760-b07f1624a2cc service nova] Creating event network-vif-deleted:9dcd846e-cfa0-472b-9e6d-3b7b0aa8c2c9 for instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f on hv-cinder-83607 May 26 17:11:39.740379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-98b3242c-b848-42bb-aac7-43cfef310261 req-9bfc198c-a464-41c8-b760-b07f1624a2cc service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031240 May 26 17:11:39.740974 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 677/1326] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:39.959482 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d4db3af9-e305-4135-82ef-dd433b0c9e9e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:39.960689 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d4db3af9-e305-4135-82ef-dd433b0c9e9e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:39.968176 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d4db3af9-e305-4135-82ef-dd433b0c9e9e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:39.968864 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d4db3af9-e305-4135-82ef-dd433b0c9e9e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:39.969645 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d4db3af9-e305-4135-82ef-dd433b0c9e9e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:39.970249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d4db3af9-e305-4135-82ef-dd433b0c9e9e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:40.039903 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d4db3af9-e305-4135-82ef-dd433b0c9e9e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:40.054132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d4db3af9-e305-4135-82ef-dd433b0c9e9e tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1329 microversion: 2.1 time: 0.096027 May 26 17:11:40.054132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 650/1327] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:39 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1329 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:41.070022 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a92507fb-fce2-41c8-83cb-f15ffcc4189a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:41.075134 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a92507fb-fce2-41c8-83cb-f15ffcc4189a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:41.078035 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a92507fb-fce2-41c8-83cb-f15ffcc4189a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:41.078628 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a92507fb-fce2-41c8-83cb-f15ffcc4189a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:41.079401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a92507fb-fce2-41c8-83cb-f15ffcc4189a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:41.079845 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a92507fb-fce2-41c8-83cb-f15ffcc4189a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:41.112567 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a92507fb-fce2-41c8-83cb-f15ffcc4189a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:41.113019 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a92507fb-fce2-41c8-83cb-f15ffcc4189a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:41.113479 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-a92507fb-fce2-41c8-83cb-f15ffcc4189a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lazy-loading 'fault' on Instance uuid 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:11:41.163716 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a92507fb-fce2-41c8-83cb-f15ffcc4189a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289cb250e20344d28bd5fd17255d5896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6412eea680c4b2bbcac2efb59aabe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:41.168369 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a92507fb-fce2-41c8-83cb-f15ffcc4189a tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 200 len: 1334 microversion: 2.1 time: 0.103150 May 26 17:11:41.176401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 678/1328] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:41 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:42.187033 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b3713103-227c-4fba-a72b-f56f5532341d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:42.187741 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b3713103-227c-4fba-a72b-f56f5532341d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:42.193881 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b3713103-227c-4fba-a72b-f56f5532341d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:42.194393 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b3713103-227c-4fba-a72b-f56f5532341d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:42.198121 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b3713103-227c-4fba-a72b-f56f5532341d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:42.198673 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b3713103-227c-4fba-a72b-f56f5532341d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:42.213175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-b3713103-227c-4fba-a72b-f56f5532341d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b3713103-227c-4fba-a72b-f56f5532341d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f HTTP/1.1 May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:11:42.214857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:11:42.216513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:11:42.216513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:42.216513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:42.216513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:42.216513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:42.216513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:11:42.216513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:11:42.216513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:11:42.216513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:42.216513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:11:42.216513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:42.216513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': '6c01d7d7-3fc2-4327-b3e7-f8415b2d323f'} May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:42.217609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:42.219232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:42.220666 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b3713103-227c-4fba-a72b-f56f5532341d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 404 to user: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:42.220666 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b3713103-227c-4fba-a72b-f56f5532341d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 404 len: 111 microversion: 2.1 time: 0.033039 May 26 17:11:42.220666 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 651/1329] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:42 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:42.225252 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-637bca58-21a0-46eb-b11a-603638918760 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '.version_select at 0x7fd250db6700>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:42.311430 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-637bca58-21a0-46eb-b11a-603638918760 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-494471729" status: 202 len: 0 microversion: 2.1 time: 0.089971 May 26 17:11:42.312041 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 679/1330] 10.222.0.112 () {58 vars in 1222 bytes} [Thu May 26 17:11:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-494471729 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:11:44.555325 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5847f06f-b7ca-4793-b2f9-873a0c270785 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:44.556371 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5847f06f-b7ca-4793-b2f9-873a0c270785 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:44.563192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5847f06f-b7ca-4793-b2f9-873a0c270785 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:44.563632 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5847f06f-b7ca-4793-b2f9-873a0c270785 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:44.564404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5847f06f-b7ca-4793-b2f9-873a0c270785 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:44.564843 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5847f06f-b7ca-4793-b2f9-873a0c270785 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:44.578979 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-5847f06f-b7ca-4793-b2f9-873a0c270785 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5847f06f-b7ca-4793-b2f9-873a0c270785 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: DELETE /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f HTTP/1.1 May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:11:44.580989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:11:44.582658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:11:44.582658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:44.582658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:44.582658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:44.582658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:44.582658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:11:44.582658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:11:44.582658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:11:44.582658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:44.582658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:11:44.582658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:44.582658 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': '6c01d7d7-3fc2-4327-b3e7-f8415b2d323f'} May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:44.583441 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:44.584643 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:44.585857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5847f06f-b7ca-4793-b2f9-873a0c270785 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 404 to user: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:44.585857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5847f06f-b7ca-4793-b2f9-873a0c270785 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 404 len: 111 microversion: 2.1 time: 0.031168 May 26 17:11:44.585857 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 652/1331] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:11:44 2022] DELETE /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:44.591735 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-11e8e15e-71f4-4c6e-962c-e896ce77bfef tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:44.592345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-11e8e15e-71f4-4c6e-962c-e896ce77bfef tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:44.600761 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-11e8e15e-71f4-4c6e-962c-e896ce77bfef tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:44.609367 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-11e8e15e-71f4-4c6e-962c-e896ce77bfef tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:44.609367 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-11e8e15e-71f4-4c6e-962c-e896ce77bfef tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:44.609367 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-11e8e15e-71f4-4c6e-962c-e896ce77bfef tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:44.615705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-11e8e15e-71f4-4c6e-962c-e896ce77bfef tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-11e8e15e-71f4-4c6e-962c-e896ce77bfef tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f HTTP/1.1 May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:11:44.617379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:11:44.620186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:11:44.620186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:44.620186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:44.620186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:44.620186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:44.620186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:11:44.620186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:11:44.620186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:11:44.620186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:44.620186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:11:44.620186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:44.620186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '6c01d7d7-3fc2-4327-b3e7-f8415b2d323f'} May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:44.621069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. May 26 17:11:44.622379 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:44.623582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-11e8e15e-71f4-4c6e-962c-e896ce77bfef tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 404 to user: Instance 6c01d7d7-3fc2-4327-b3e7-f8415b2d323f could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:44.623582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-11e8e15e-71f4-4c6e-962c-e896ce77bfef tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f" status: 404 len: 111 microversion: 2.1 time: 0.032271 May 26 17:11:44.623582 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 680/1332] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:44 2022] GET /compute/v2.1/servers/6c01d7d7-3fc2-4327-b3e7-f8415b2d323f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:46.076308 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e5285c82-db8b-4745-bb92-58198bc236ba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:46.076815 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e5285c82-db8b-4745-bb92-58198bc236ba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:46.083399 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e5285c82-db8b-4745-bb92-58198bc236ba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:46.083846 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e5285c82-db8b-4745-bb92-58198bc236ba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:46.084609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e5285c82-db8b-4745-bb92-58198bc236ba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:46.085041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e5285c82-db8b-4745-bb92-58198bc236ba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:46.099439 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-e5285c82-db8b-4745-bb92-58198bc236ba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e5285c82-db8b-4745-bb92-58198bc236ba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: DELETE /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a HTTP/1.1 May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:11:46.100972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:11:46.102698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:11:46.102698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:46.102698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:46.102698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:46.102698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:46.102698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:11:46.102698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:11:46.102698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:11:46.102698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:46.102698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:11:46.102698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:11:46.102698 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': 'bb71ce55-ab15-4719-9bd9-3cf739fb322a'} May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:46.103649 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:11:46.104919 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:46.106185 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e5285c82-db8b-4745-bb92-58198bc236ba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 404 to user: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:46.106185 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e5285c82-db8b-4745-bb92-58198bc236ba tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 404 len: 111 microversion: 2.1 time: 0.030978 May 26 17:11:46.106185 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 653/1333] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:11:46 2022] DELETE /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:46.111986 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0fbec4f9-9cb7-4da5-9934-a78d37f306a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:46.112698 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0fbec4f9-9cb7-4da5-9934-a78d37f306a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: bb71ce55-ab15-4719-9bd9-3cf739fb322a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:46.120285 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0fbec4f9-9cb7-4da5-9934-a78d37f306a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:46.120771 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0fbec4f9-9cb7-4da5-9934-a78d37f306a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:46.121555 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0fbec4f9-9cb7-4da5-9934-a78d37f306a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:46.121995 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0fbec4f9-9cb7-4da5-9934-a78d37f306a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:46.136660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-0fbec4f9-9cb7-4da5-9934-a78d37f306a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0fbec4f9-9cb7-4da5-9934-a78d37f306a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a HTTP/1.1 May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:11:46.138224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:11:46.139778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:11:46.139778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:46.139778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:46.139778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:46.139778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:46.139778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:11:46.139778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:11:46.139778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:11:46.139778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:46.139778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:11:46.139778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:11:46.139778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'bb71ce55-ab15-4719-9bd9-3cf739fb322a'} May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:46.140547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. May 26 17:11:46.141796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:46.142922 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0fbec4f9-9cb7-4da5-9934-a78d37f306a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 404 to user: Instance bb71ce55-ab15-4719-9bd9-3cf739fb322a could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:46.142922 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0fbec4f9-9cb7-4da5-9934-a78d37f306a7 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a" status: 404 len: 111 microversion: 2.1 time: 0.031468 May 26 17:11:46.142922 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 681/1334] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:46 2022] GET /compute/v2.1/servers/bb71ce55-ab15-4719-9bd9-3cf739fb322a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:46.148126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4a14400e-31f6-4c0e-a574-5bfe8def6936 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:46.148614 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4a14400e-31f6-4c0e-a574-5bfe8def6936 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:46.154762 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a14400e-31f6-4c0e-a574-5bfe8def6936 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:46.155203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a14400e-31f6-4c0e-a574-5bfe8def6936 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:46.156158 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a14400e-31f6-4c0e-a574-5bfe8def6936 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:46.156588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a14400e-31f6-4c0e-a574-5bfe8def6936 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:46.172240 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-4a14400e-31f6-4c0e-a574-5bfe8def6936 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4a14400e-31f6-4c0e-a574-5bfe8def6936 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: DELETE /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 HTTP/1.1 May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:11:46.173779 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:11:46.175572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:11:46.175572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:46.175572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:46.175572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:46.175572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:46.175572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:11:46.175572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:11:46.175572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:11:46.175572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:46.175572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:11:46.175572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:11:46.175572 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': '1248649c-ce32-42fd-8764-3a985faf06b8'} May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:46.176423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:11:46.177901 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:46.179404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4a14400e-31f6-4c0e-a574-5bfe8def6936 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 404 to user: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:46.179404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4a14400e-31f6-4c0e-a574-5bfe8def6936 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 404 len: 111 microversion: 2.1 time: 0.030821 May 26 17:11:46.179404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 654/1335] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:11:46 2022] DELETE /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:46.184484 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-163800b0-1bde-4c1e-9e79-07143f7c8281 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:46.190894 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-163800b0-1bde-4c1e-9e79-07143f7c8281 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 1248649c-ce32-42fd-8764-3a985faf06b8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:46.191764 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-163800b0-1bde-4c1e-9e79-07143f7c8281 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:46.192221 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-163800b0-1bde-4c1e-9e79-07143f7c8281 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:46.192993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-163800b0-1bde-4c1e-9e79-07143f7c8281 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:46.193464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-163800b0-1bde-4c1e-9e79-07143f7c8281 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:46.208717 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-163800b0-1bde-4c1e-9e79-07143f7c8281 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-163800b0-1bde-4c1e-9e79-07143f7c8281 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 HTTP/1.1 May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:11:46.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:11:46.211793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:11:46.211793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:46.211793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:46.211793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:46.211793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:46.211793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:11:46.211793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:11:46.211793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:11:46.211793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:46.211793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:11:46.211793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:11:46.211793 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '1248649c-ce32-42fd-8764-3a985faf06b8'} May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:46.212765 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. May 26 17:11:46.214087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:46.215271 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-163800b0-1bde-4c1e-9e79-07143f7c8281 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 404 to user: Instance 1248649c-ce32-42fd-8764-3a985faf06b8 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:46.215271 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-163800b0-1bde-4c1e-9e79-07143f7c8281 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8" status: 404 len: 111 microversion: 2.1 time: 0.031828 May 26 17:11:46.215271 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 682/1336] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:46 2022] GET /compute/v2.1/servers/1248649c-ce32-42fd-8764-3a985faf06b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:47.520224 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-280d45a4-7409-41f0-9d0e-b483453604d5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:47.520726 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-280d45a4-7409-41f0-9d0e-b483453604d5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:47.528405 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-280d45a4-7409-41f0-9d0e-b483453604d5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:47.528854 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-280d45a4-7409-41f0-9d0e-b483453604d5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:47.529639 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-280d45a4-7409-41f0-9d0e-b483453604d5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:47.530073 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-280d45a4-7409-41f0-9d0e-b483453604d5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:47.544076 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-280d45a4-7409-41f0-9d0e-b483453604d5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-280d45a4-7409-41f0-9d0e-b483453604d5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: DELETE /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 HTTP/1.1 May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:11:47.545618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:11:47.547228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:11:47.547228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:47.547228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:47.547228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:47.547228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:47.547228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:11:47.547228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:11:47.547228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:11:47.547228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:47.547228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:11:47.547228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:11:47.547228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': '60352cdb-28fe-49a5-85e8-ae2c9c92b184'} May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:47.548253 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:11:47.549876 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:47.554283 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-280d45a4-7409-41f0-9d0e-b483453604d5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 404 to user: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:47.554283 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-280d45a4-7409-41f0-9d0e-b483453604d5 tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "DELETE /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 404 len: 111 microversion: 2.1 time: 0.030651 May 26 17:11:47.554283 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 655/1337] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:11:47 2022] DELETE /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:47.560681 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-858f701e-6fbf-4da9-87e3-60716f213b5d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:47.561468 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-858f701e-6fbf-4da9-87e3-60716f213b5d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] [instance: 60352cdb-28fe-49a5-85e8-ae2c9c92b184] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:47.568139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-858f701e-6fbf-4da9-87e3-60716f213b5d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:47.568593 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-858f701e-6fbf-4da9-87e3-60716f213b5d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:47.569362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-858f701e-6fbf-4da9-87e3-60716f213b5d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:47.569804 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-858f701e-6fbf-4da9-87e3-60716f213b5d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:47.584453 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-858f701e-6fbf-4da9-87e3-60716f213b5d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] HTTP exception thrown: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-858f701e-6fbf-4da9-87e3-60716f213b5d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Request method failure captured: May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 HTTP/1.1 May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GUdz2ppRQZ6ZNvZFVscRf7ZYci3Erh9XCeDnHZKussLQhw-Mt8MNjnTjfpnuUnsgZ-Jr43lxx4uwpRFignW_jcp6B4RxbB8oy6cPwyCXTRewvcO5OZzU1R96vvADUhICNBZGpK8KHiOTnLBTXOE27xbzpD7WYTV-JI2UMCVE3Lv4Y May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:11:47.585982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:11:47.591763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/e6412eea680c4b2bbcac2efb59aabe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_e6412eea680c4b2bbcac2efb59aabe52"}]}] May 26 17:11:47.591763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:47.591763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: e6412eea680c4b2bbcac2efb59aabe52 May 26 17:11:47.591763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-346737285 May 26 17:11:47.591763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:47.591763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:11:47.591763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:11:47.591763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 289cb250e20344d28bd5fd17255d5896 May 26 17:11:47.591763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeNegativeTest-346737285-project May 26 17:11:47.591763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:11:47.591763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:11:47.591763 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '60352cdb-28fe-49a5-85e8-ae2c9c92b184'} May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:47.592715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. May 26 17:11:47.594940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:47.596333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-858f701e-6fbf-4da9-87e3-60716f213b5d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] Returning 404 to user: Instance 60352cdb-28fe-49a5-85e8-ae2c9c92b184 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:47.596333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-858f701e-6fbf-4da9-87e3-60716f213b5d tempest-AttachVolumeNegativeTest-346737285 tempest-AttachVolumeNegativeTest-346737285-project] 10.222.0.112 "GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184" status: 404 len: 111 microversion: 2.1 time: 0.031379 May 26 17:11:47.596333 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 683/1338] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:47 2022] GET /compute/v2.1/servers/60352cdb-28fe-49a5-85e8-ae2c9c92b184 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:11:49.887420 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4e8f1279-36e9-45a5-9f84-92d2cdbba289 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:49.889291 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4e8f1279-36e9-45a5-9f84-92d2cdbba289 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:49.898263 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e8f1279-36e9-45a5-9f84-92d2cdbba289 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:49.900771 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e8f1279-36e9-45a5-9f84-92d2cdbba289 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:49.900771 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e8f1279-36e9-45a5-9f84-92d2cdbba289 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:49.902053 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e8f1279-36e9-45a5-9f84-92d2cdbba289 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:49.954256 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4e8f1279-36e9-45a5-9f84-92d2cdbba289 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.072217 May 26 17:11:49.958266 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 656/1339] 10.222.0.112 () {60 vars in 1347 bytes} [Thu May 26 17:11:49 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:50.020938 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a1796742-9235-4d1f-ac23-951a1672a9d0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:50.021535 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a1796742-9235-4d1f-ac23-951a1672a9d0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:50.028282 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a1796742-9235-4d1f-ac23-951a1672a9d0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:50.028805 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a1796742-9235-4d1f-ac23-951a1672a9d0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:50.029705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a1796742-9235-4d1f-ac23-951a1672a9d0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:50.030203 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a1796742-9235-4d1f-ac23-951a1672a9d0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:50.058030 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a1796742-9235-4d1f-ac23-951a1672a9d0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Going to try to terminate instance {{(pid=130526) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:11:50.453452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a1796742-9235-4d1f-ac23-951a1672a9d0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "DELETE /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 204 len: 0 microversion: 2.20 time: 0.436766 May 26 17:11:50.454040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 684/1340] 10.222.0.112 () {60 vars in 1284 bytes} [Thu May 26 17:11:50 2022] DELETE /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 17:11:50.462651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3f10357c-ad9b-4a5f-bdd4-81d3d6a689c5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:50.463267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3f10357c-ad9b-4a5f-bdd4-81d3d6a689c5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:50.469409 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3f10357c-ad9b-4a5f-bdd4-81d3d6a689c5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:50.469928 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3f10357c-ad9b-4a5f-bdd4-81d3d6a689c5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:50.470733 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3f10357c-ad9b-4a5f-bdd4-81d3d6a689c5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:50.471170 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3f10357c-ad9b-4a5f-bdd4-81d3d6a689c5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:50.607142 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3f10357c-ad9b-4a5f-bdd4-81d3d6a689c5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:50.615755 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3f10357c-ad9b-4a5f-bdd4-81d3d6a689c5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:50.617583 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3f10357c-ad9b-4a5f-bdd4-81d3d6a689c5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:50.618966 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3f10357c-ad9b-4a5f-bdd4-81d3d6a689c5 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.160352 May 26 17:11:50.619700 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 657/1341] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:11:50 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:11:51.640258 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2fb827e3-81e0-4679-b963-135504e42953 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:51.640920 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2fb827e3-81e0-4679-b963-135504e42953 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:51.647963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2fb827e3-81e0-4679-b963-135504e42953 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:51.648643 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2fb827e3-81e0-4679-b963-135504e42953 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:51.650206 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2fb827e3-81e0-4679-b963-135504e42953 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:51.650939 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2fb827e3-81e0-4679-b963-135504e42953 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:51.845893 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2fb827e3-81e0-4679-b963-135504e42953 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:51.855070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2fb827e3-81e0-4679-b963-135504e42953 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:51.856599 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2fb827e3-81e0-4679-b963-135504e42953 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:51.857868 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2fb827e3-81e0-4679-b963-135504e42953 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.222454 May 26 17:11:51.858668 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 685/1342] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:11:51 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:11:52.877179 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e1225674-eeca-4cc3-b4cd-4b98b56b9886 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:52.877882 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e1225674-eeca-4cc3-b4cd-4b98b56b9886 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:52.884300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e1225674-eeca-4cc3-b4cd-4b98b56b9886 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:52.884851 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e1225674-eeca-4cc3-b4cd-4b98b56b9886 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:52.885637 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e1225674-eeca-4cc3-b4cd-4b98b56b9886 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:52.886082 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e1225674-eeca-4cc3-b4cd-4b98b56b9886 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:53.026657 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e1225674-eeca-4cc3-b4cd-4b98b56b9886 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:53.035448 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e1225674-eeca-4cc3-b4cd-4b98b56b9886 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:53.036940 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e1225674-eeca-4cc3-b4cd-4b98b56b9886 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:53.038105 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e1225674-eeca-4cc3-b4cd-4b98b56b9886 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1728 microversion: 2.20 time: 0.164832 May 26 17:11:53.038687 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 658/1343] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:11:52 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:11:54.057113 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-7ffa7d8e-4a64-4695-bee7-a136079b2103 req-959dd5d8-57a5-476f-9ae8-a1e90b272fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dca66e2-797a-492c-aa32-e2bb881ac25b", "name": "network-vif-deleted", "tag": "4e63cdc0-f462-4b50-8bc7-40551bf2f0ba"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:11:54.059475 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5e6a3af8-c189-43af-b5ff-f955238e80c8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:54.061176 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5e6a3af8-c189-43af-b5ff-f955238e80c8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:54.066674 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-7ffa7d8e-4a64-4695-bee7-a136079b2103 req-959dd5d8-57a5-476f-9ae8-a1e90b272fc2 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:54.067115 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-7ffa7d8e-4a64-4695-bee7-a136079b2103 req-959dd5d8-57a5-476f-9ae8-a1e90b272fc2 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:54.072748 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5e6a3af8-c189-43af-b5ff-f955238e80c8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:54.073312 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5e6a3af8-c189-43af-b5ff-f955238e80c8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:54.074148 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5e6a3af8-c189-43af-b5ff-f955238e80c8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:54.074671 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5e6a3af8-c189-43af-b5ff-f955238e80c8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:54.081793 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-7ffa7d8e-4a64-4695-bee7-a136079b2103 req-959dd5d8-57a5-476f-9ae8-a1e90b272fc2 service nova] Creating event network-vif-deleted:4e63cdc0-f462-4b50-8bc7-40551bf2f0ba for instance 4dca66e2-797a-492c-aa32-e2bb881ac25b on hv-cinder-83607 May 26 17:11:54.088438 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-7ffa7d8e-4a64-4695-bee7-a136079b2103 req-959dd5d8-57a5-476f-9ae8-a1e90b272fc2 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035167 May 26 17:11:54.089648 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 659/1344] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:54.167746 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5e6a3af8-c189-43af-b5ff-f955238e80c8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:54.179972 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5e6a3af8-c189-43af-b5ff-f955238e80c8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:54.183010 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5e6a3af8-c189-43af-b5ff-f955238e80c8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:54.184678 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5e6a3af8-c189-43af-b5ff-f955238e80c8 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1660 microversion: 2.20 time: 0.131836 May 26 17:11:54.185753 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 686/1345] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:11:54 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1660 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:11:54.319890 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-99fe2f68-5f1e-4236-bc7c-52052fe4148b tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Action: 'create', calling method: .version_select at 0x7fd2513b39d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-82844853"}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:11:55.204220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:55.204834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:55.215003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:55.220509 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:55.220509 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:55.220509 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:55.254175 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:55.254715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:55.255232 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lazy-loading 'fault' on Instance uuid 4dca66e2-797a-492c-aa32-e2bb881ac25b {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:11:55.307555 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:55.317060 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:55.318879 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e09f6a92f064ec78231fa06782bafda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9ae847a0d449ab9c875f8a4f936d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:55.320084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-13549260-8faa-4b3e-a064-71f18d73b141 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 200 len: 1376 microversion: 2.20 time: 0.119800 May 26 17:11:55.321161 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 687/1346] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:11:55 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 1376 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:11:55.467767 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-99fe2f68-5f1e-4236-bc7c-52052fe4148b tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 1.298957 May 26 17:11:55.468394 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 660/1347] 10.222.0.112 () {60 vars in 1159 bytes} [Thu May 26 17:11:54 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 1300 msecs (HTTP/1.1 200) 10 headers in 449 bytes (2 switches on core 0) May 26 17:11:55.480784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9d4e32db-12ac-42f9-a8a5-a6f25cf0d2dc tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd2562323a0>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:55.533630 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9d4e32db-12ac-42f9-a8a5-a6f25cf0d2dc tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8" status: 200 len: 343 microversion: 2.1 time: 0.057315 May 26 17:11:55.534202 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 688/1348] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:11:55 2022] GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8 => generated 343 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:56.340321 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-aef1e374-f628-4310-990d-30e0b73ffc20 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:56.341202 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-aef1e374-f628-4310-990d-30e0b73ffc20 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:56.348135 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aef1e374-f628-4310-990d-30e0b73ffc20 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:56.348613 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aef1e374-f628-4310-990d-30e0b73ffc20 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:56.349386 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aef1e374-f628-4310-990d-30e0b73ffc20 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:56.349910 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aef1e374-f628-4310-990d-30e0b73ffc20 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:56.363800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-aef1e374-f628-4310-990d-30e0b73ffc20 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] HTTP exception thrown: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-aef1e374-f628-4310-990d-30e0b73ffc20 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Request method failure captured: May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b HTTP/1.1 May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7GbzCgiZk59vHpDkcrPHVdJ6eBbq3ZN7mPQ_jki-Cnud1ZGJE-hnmfeAREoNiozhYPx5WjZvvBOlx0pN1ljf7ZQUCIPRYf_PqV44iAX8UC9LpMuGLkK_1XlkWtyYk5MJCcD2hYoGIuHDXSqIRkN3MGkUjNbjXAC1anwqPwQkkH1r0Q May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Openstack-Nova-Api-Version: 2.20 May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 0c9ae847a0d449ab9c875f8a4f936d6a May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:11:56.365453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:11:56.367196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_0c9ae847a0d449ab9c875f8a4f936d6a"}]}] May 26 17:11:56.367196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:11:56.367196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 0c9ae847a0d449ab9c875f8a4f936d6a May 26 17:11:56.367196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:11:56.367196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-AttachVolumeShelveTestJSON-672346481-project May 26 17:11:56.367196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:11:56.367196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:11:56.367196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 9e09f6a92f064ec78231fa06782bafda May 26 17:11:56.367196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-AttachVolumeShelveTestJSON-672346481-project May 26 17:11:56.367196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:11:56.367196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:56.367196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': '4dca66e2-797a-492c-aa32-e2bb881ac25b'} May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:56.368597 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:56.370443 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:11:56.371600 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-aef1e374-f628-4310-990d-30e0b73ffc20 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Returning 404 to user: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:56.371600 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-aef1e374-f628-4310-990d-30e0b73ffc20 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 404 len: 111 microversion: 2.20 time: 0.031766 May 26 17:11:56.371600 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 661/1349] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:11:56 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 17:11:56.376458 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2c608458-bc12-4186-a9c2-569c862454b0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '.version_select at 0x7fd256232f70>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:56.490898 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2c608458-bc12-4186-a9c2-569c862454b0 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176932179" status: 204 len: 0 microversion: 2.20 time: 0.118148 May 26 17:11:56.491488 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 689/1350] 10.222.0.112 () {60 vars in 1266 bytes} [Thu May 26 17:11:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176932179 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 17:11:56.547163 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9a271bef-0a8c-4a7c-b119-1c375ba63eb8 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd2513b3940>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:56.596911 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9a271bef-0a8c-4a7c-b119-1c375ba63eb8 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8" status: 200 len: 343 microversion: 2.1 time: 0.054106 May 26 17:11:56.597566 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 662/1351] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:11:56 2022] GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8 => generated 343 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:57.610094 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0e89e185-28f5-40d4-ac0a-ece2dd557be6 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd250db63a0>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:57.658315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0e89e185-28f5-40d4-ac0a-ece2dd557be6 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8" status: 200 len: 344 microversion: 2.1 time: 0.052586 May 26 17:11:57.658902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 690/1352] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:11:57 2022] GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:57.671233 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8f9c9752-23fe-497d-a8b0-2349c7a789b3 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Action: 'create', calling method: .version_select at 0x7fd256221940>, body: {"snapshot": {"volume_id": "da0108f7-980c-4e0a-97ef-46cf2caa8ca8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-513188929"}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:11:58.223354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8f9c9752-23fe-497d-a8b0-2349c7a789b3 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.556306 May 26 17:11:58.223930 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 663/1353] 10.222.0.112 () {60 vars in 1166 bytes} [Thu May 26 17:11:57 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:58.238103 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-589a3ca7-f67c-438a-8871-e34d68e2a78f tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd250dbe310>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:58.263003 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-589a3ca7-f67c-438a-8871-e34d68e2a78f tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0" status: 200 len: 286 microversion: 2.1 time: 0.032472 May 26 17:11:58.266253 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 691/1354] 10.222.0.112 () {58 vars in 1255 bytes} [Thu May 26 17:11:58 2022] GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:11:58.273086 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-60343a82-b3b9-45dd-9d60-0b17b647b95a tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd2512d99d0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:58.309042 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-60343a82-b3b9-45dd-9d60-0b17b647b95a tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.039514 May 26 17:11:58.309754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 664/1355] 10.222.0.112 () {58 vars in 1144 bytes} [Thu May 26 17:11:58 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:58.324384 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e15dcd75-9eab-4cd7-b4a8-91062f6c247e tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd251084a60>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:58.357059 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e15dcd75-9eab-4cd7-b4a8-91062f6c247e tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0" status: 200 len: 286 microversion: 2.1 time: 0.037091 May 26 17:11:58.357637 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 692/1356] 10.222.0.112 () {58 vars in 1255 bytes} [Thu May 26 17:11:58 2022] GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:11:58.422972 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1656546794", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "networks": [{"uuid": "7284e265-d11f-4bc2-b6f6-f0a16830bd27"}]}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:11:58.476848 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.network.neutron [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] validate_networks() for [('7284e265-d11f-4bc2-b6f6-f0a16830bd27', None, None, None, None, None)] {{(pid=130525) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:11:58.667362 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ccf921a7-f0ab-41f3-a735-01ab0c730666 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:58.671499 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ccf921a7-f0ab-41f3-a735-01ab0c730666 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:58.674258 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ccf921a7-f0ab-41f3-a735-01ab0c730666 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:58.674745 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ccf921a7-f0ab-41f3-a735-01ab0c730666 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:58.675544 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ccf921a7-f0ab-41f3-a735-01ab0c730666 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:58.675981 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ccf921a7-f0ab-41f3-a735-01ab0c730666 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:58.689437 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-ccf921a7-f0ab-41f3-a735-01ab0c730666 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] HTTP exception thrown: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ccf921a7-f0ab-41f3-a735-01ab0c730666 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Request method failure captured: May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: DELETE /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b HTTP/1.1 May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GbzCgiZk59vHpDkcrPHVdJ6eBbq3ZN7mPQ_jki-Cnud1ZGJE-hnmfeAREoNiozhYPx5WjZvvBOlx0pN1ljf7ZQUCIPRYf_PqV44iAX8UC9LpMuGLkK_1XlkWtyYk5MJCcD2hYoGIuHDXSqIRkN3MGkUjNbjXAC1anwqPwQkkH1r0Q May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Openstack-Nova-Api-Version: 2.20 May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 0c9ae847a0d449ab9c875f8a4f936d6a May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:11:58.691149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:11:58.692783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_0c9ae847a0d449ab9c875f8a4f936d6a"}]}] May 26 17:11:58.692783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:11:58.692783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 0c9ae847a0d449ab9c875f8a4f936d6a May 26 17:11:58.692783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:11:58.692783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeShelveTestJSON-672346481-project May 26 17:11:58.692783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:11:58.692783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:11:58.692783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 9e09f6a92f064ec78231fa06782bafda May 26 17:11:58.692783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeShelveTestJSON-672346481-project May 26 17:11:58.692783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:11:58.692783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:58.692783 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '4dca66e2-797a-492c-aa32-e2bb881ac25b'} May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:58.693927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:58.695358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:58.696837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ccf921a7-f0ab-41f3-a735-01ab0c730666 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Returning 404 to user: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:58.696837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ccf921a7-f0ab-41f3-a735-01ab0c730666 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "DELETE /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 404 len: 111 microversion: 2.20 time: 0.029854 May 26 17:11:58.696837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 693/1357] 10.222.0.112 () {60 vars in 1284 bytes} [Thu May 26 17:11:58 2022] DELETE /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 17:11:58.703066 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6da8c58b-7b80-429e-bfe0-0c6311f95d09 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:58.703680 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6da8c58b-7b80-429e-bfe0-0c6311f95d09 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 4dca66e2-797a-492c-aa32-e2bb881ac25b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:58.710139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6da8c58b-7b80-429e-bfe0-0c6311f95d09 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:58.710637 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6da8c58b-7b80-429e-bfe0-0c6311f95d09 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:58.711451 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6da8c58b-7b80-429e-bfe0-0c6311f95d09 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:58.711837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6da8c58b-7b80-429e-bfe0-0c6311f95d09 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:58.726481 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-6da8c58b-7b80-429e-bfe0-0c6311f95d09 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] HTTP exception thrown: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6da8c58b-7b80-429e-bfe0-0c6311f95d09 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Request method failure captured: May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b HTTP/1.1 May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GbzCgiZk59vHpDkcrPHVdJ6eBbq3ZN7mPQ_jki-Cnud1ZGJE-hnmfeAREoNiozhYPx5WjZvvBOlx0pN1ljf7ZQUCIPRYf_PqV44iAX8UC9LpMuGLkK_1XlkWtyYk5MJCcD2hYoGIuHDXSqIRkN3MGkUjNbjXAC1anwqPwQkkH1r0Q May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Openstack-Nova-Api-Version: 2.20 May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 0c9ae847a0d449ab9c875f8a4f936d6a May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:11:58.728024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:11:58.730023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_0c9ae847a0d449ab9c875f8a4f936d6a"}]}] May 26 17:11:58.730023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:11:58.730023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 0c9ae847a0d449ab9c875f8a4f936d6a May 26 17:11:58.730023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:11:58.730023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeShelveTestJSON-672346481-project May 26 17:11:58.730023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:11:58.730023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:11:58.730023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 9e09f6a92f064ec78231fa06782bafda May 26 17:11:58.730023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeShelveTestJSON-672346481-project May 26 17:11:58.730023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:11:58.730023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:58.730023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '4dca66e2-797a-492c-aa32-e2bb881ac25b'} May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:11:58.730993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. May 26 17:11:58.732493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:11:58.733860 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6da8c58b-7b80-429e-bfe0-0c6311f95d09 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Returning 404 to user: Instance 4dca66e2-797a-492c-aa32-e2bb881ac25b could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:11:58.733860 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6da8c58b-7b80-429e-bfe0-0c6311f95d09 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b" status: 404 len: 111 microversion: 2.20 time: 0.030864 May 26 17:11:58.733860 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 694/1358] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:11:58 2022] GET /compute/v2.1/servers/4dca66e2-797a-492c-aa32-e2bb881ac25b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 17:11:58.828524 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Flavor limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:11:58.829012 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Image limits 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:11:58.829478 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Flavor pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:11:58.829942 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Image pref 0:0:0 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:11:58.830456 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.virt.hardware [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:11:58.841741 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:58.842180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:58.843364 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:11:58.843470 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:11:58.861002 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Getting quotas for project 3511d2b2c4014889ae449a05344ff57d. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:11:58.865065 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.quota [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Getting quotas for user 21c11bd00fde4b6a914ce707a502784a and project 3511d2b2c4014889ae449a05344ff57d. Resources: {'cores', 'ram', 'instances'} {{(pid=130525) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:11:58.876538 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Going to run 1 instances... {{(pid=130525) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:11:58.878818 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:11:59.138839 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-2660bb0b-c5ce-40b2-b9f2-5736611cf11f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.719588 May 26 17:11:59.139488 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 665/1359] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:11:58 2022] POST /compute/v2.1/servers => generated 382 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:11:59.149214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-84464c39-3a1f-4911-b4a2-4ee9b8df43a4 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:59.149828 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-84464c39-3a1f-4911-b4a2-4ee9b8df43a4 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:11:59.211864 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-84464c39-3a1f-4911-b4a2-4ee9b8df43a4 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:11:59.219856 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-84464c39-3a1f-4911-b4a2-4ee9b8df43a4 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1218 microversion: 2.1 time: 0.074322 May 26 17:11:59.220381 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 695/1360] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:11:59 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:11:59.368934 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-478c9875-64ee-4eba-9105-83416b66dce2 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd256221160>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:11:59.398210 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-478c9875-64ee-4eba-9105-83416b66dce2 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0" status: 200 len: 286 microversion: 2.1 time: 0.033157 May 26 17:11:59.398806 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 666/1361] 10.222.0.112 () {58 vars in 1255 bytes} [Thu May 26 17:11:59 2022] GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:00.239139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e998e586-d7e0-4204-88e9-cfbb1d6b34f5 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:00.246791 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e998e586-d7e0-4204-88e9-cfbb1d6b34f5 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:00.299055 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e998e586-d7e0-4204-88e9-cfbb1d6b34f5 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:00.308129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e998e586-d7e0-4204-88e9-cfbb1d6b34f5 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1218 microversion: 2.1 time: 0.074862 May 26 17:12:00.308721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 696/1362] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:00 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:00.411318 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a95882cd-2bed-4a56-bba6-cbec1cf3ed8f tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd2561b33a0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:00.442887 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a95882cd-2bed-4a56-bba6-cbec1cf3ed8f tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0" status: 200 len: 286 microversion: 2.1 time: 0.035804 May 26 17:12:00.443457 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 667/1363] 10.222.0.112 () {58 vars in 1255 bytes} [Thu May 26 17:12:00 2022] GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:01.327280 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c8c8fa5f-1143-42d2-984a-bfbf5da5fa27 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:01.327877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c8c8fa5f-1143-42d2-984a-bfbf5da5fa27 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:01.334646 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c8c8fa5f-1143-42d2-984a-bfbf5da5fa27 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:01.335095 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c8c8fa5f-1143-42d2-984a-bfbf5da5fa27 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:01.335861 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c8c8fa5f-1143-42d2-984a-bfbf5da5fa27 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:01.336291 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c8c8fa5f-1143-42d2-984a-bfbf5da5fa27 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:01.397008 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c8c8fa5f-1143-42d2-984a-bfbf5da5fa27 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:01.404465 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c8c8fa5f-1143-42d2-984a-bfbf5da5fa27 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1222 microversion: 2.1 time: 0.081209 May 26 17:12:01.405034 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 697/1364] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:01 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:01.458842 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c0383d07-2ed3-450e-a7ec-792737d800fb tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd2561c1550>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:01.486922 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c0383d07-2ed3-450e-a7ec-792737d800fb tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0" status: 200 len: 286 microversion: 2.1 time: 0.036206 May 26 17:12:01.487520 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 668/1365] 10.222.0.112 () {58 vars in 1255 bytes} [Thu May 26 17:12:01 2022] GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:02.420674 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-89c1d281-e027-40a4-8ccf-3a86d22c6803 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:02.421401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-89c1d281-e027-40a4-8ccf-3a86d22c6803 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:02.427934 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-89c1d281-e027-40a4-8ccf-3a86d22c6803 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:02.428383 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-89c1d281-e027-40a4-8ccf-3a86d22c6803 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:02.429144 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-89c1d281-e027-40a4-8ccf-3a86d22c6803 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:02.429577 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-89c1d281-e027-40a4-8ccf-3a86d22c6803 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:02.499262 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-02d4a3de-d7b5-4729-b0d3-2818ef8adfcf tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd251078310>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:02.516038 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-89c1d281-e027-40a4-8ccf-3a86d22c6803 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:02.523730 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-89c1d281-e027-40a4-8ccf-3a86d22c6803 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1222 microversion: 2.1 time: 0.106884 May 26 17:12:02.524364 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 698/1366] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:02 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:02.535838 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-02d4a3de-d7b5-4729-b0d3-2818ef8adfcf tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0" status: 200 len: 286 microversion: 2.1 time: 0.040303 May 26 17:12:02.536538 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 669/1367] 10.222.0.112 () {58 vars in 1255 bytes} [Thu May 26 17:12:02 2022] GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:12:03.333641 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-39bbf798-bd06-4b36-a9ff-336b64dc305a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:03.334130 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-39bbf798-bd06-4b36-a9ff-336b64dc305a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:03.347042 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-39bbf798-bd06-4b36-a9ff-336b64dc305a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:03.347495 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-39bbf798-bd06-4b36-a9ff-336b64dc305a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:03.348265 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-39bbf798-bd06-4b36-a9ff-336b64dc305a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:03.348696 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-39bbf798-bd06-4b36-a9ff-336b64dc305a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:03.375897 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-39bbf798-bd06-4b36-a9ff-336b64dc305a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Going to try to terminate instance {{(pid=130526) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:12:03.390730 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:03.405740 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-aa8c4e3d-625c-4360-af1e-6700414824c6 req-3ae7234d-cd43-4d35-b70a-b009e9a6f38e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674dca1d-7dd2-42f4-8ddc-f9742a6d688d", "tag": "0ca04129-6455-4066-a7dd-a0f93617531c"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:12:03.411103 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:03.415484 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-aa8c4e3d-625c-4360-af1e-6700414824c6 req-3ae7234d-cd43-4d35-b70a-b009e9a6f38e service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:03.416226 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-aa8c4e3d-625c-4360-af1e-6700414824c6 req-3ae7234d-cd43-4d35-b70a-b009e9a6f38e service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:03.419619 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:03.430436 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-aa8c4e3d-625c-4360-af1e-6700414824c6 req-3ae7234d-cd43-4d35-b70a-b009e9a6f38e service nova] Creating event network-changed:0ca04129-6455-4066-a7dd-a0f93617531c for instance 674dca1d-7dd2-42f4-8ddc-f9742a6d688d on hv-cinder-83607 May 26 17:12:03.436581 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-aa8c4e3d-625c-4360-af1e-6700414824c6 req-3ae7234d-cd43-4d35-b70a-b009e9a6f38e service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100900 May 26 17:12:03.437497 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 670/1368] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:03.544813 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fc1f5610-e390-434a-a8fe-50dfcc9cecdf tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:03.546639 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fc1f5610-e390-434a-a8fe-50dfcc9cecdf tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:03.554631 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fc1f5610-e390-434a-a8fe-50dfcc9cecdf tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:03.555359 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fc1f5610-e390-434a-a8fe-50dfcc9cecdf tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:03.556818 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fc1f5610-e390-434a-a8fe-50dfcc9cecdf tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:03.557537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fc1f5610-e390-434a-a8fe-50dfcc9cecdf tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:03.665841 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fc1f5610-e390-434a-a8fe-50dfcc9cecdf tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:03.682820 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fc1f5610-e390-434a-a8fe-50dfcc9cecdf tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1214 microversion: 2.1 time: 0.145307 May 26 17:12:03.692786 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 671/1369] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:03 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:12:03.694401 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-91170435-a68a-4884-9d71-2496084cf431 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd250ff5700>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:03.732637 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-91170435-a68a-4884-9d71-2496084cf431 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0" status: 200 len: 286 microversion: 2.1 time: 0.044524 May 26 17:12:03.737066 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 672/1370] 10.222.0.112 () {58 vars in 1255 bytes} [Thu May 26 17:12:03 2022] GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:03.810455 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-39bbf798-bd06-4b36-a9ff-336b64dc305a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "DELETE /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 204 len: 0 microversion: 2.1 time: 0.480509 May 26 17:12:03.811082 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 699/1371] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:12:03 2022] DELETE /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:12:03.819162 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6687cc1c-185e-48bd-abe3-5b69182b7538 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:03.819774 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6687cc1c-185e-48bd-abe3-5b69182b7538 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:03.826261 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6687cc1c-185e-48bd-abe3-5b69182b7538 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:03.826758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6687cc1c-185e-48bd-abe3-5b69182b7538 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:03.827530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6687cc1c-185e-48bd-abe3-5b69182b7538 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:03.827967 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6687cc1c-185e-48bd-abe3-5b69182b7538 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:04.227249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6687cc1c-185e-48bd-abe3-5b69182b7538 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:04.236114 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6687cc1c-185e-48bd-abe3-5b69182b7538 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1580 microversion: 2.1 time: 0.420775 May 26 17:12:04.236686 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 673/1372] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:03 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1580 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:04.701878 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-819b4464-b340-46b6-82f9-cb39386ca642 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:04.702672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-819b4464-b340-46b6-82f9-cb39386ca642 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:04.709768 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-819b4464-b340-46b6-82f9-cb39386ca642 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:04.710221 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-819b4464-b340-46b6-82f9-cb39386ca642 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:04.711016 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-819b4464-b340-46b6-82f9-cb39386ca642 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:04.711451 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-819b4464-b340-46b6-82f9-cb39386ca642 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:04.744848 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-97f3c2ea-b21f-4ec0-828b-246601180fc3 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd251057dc0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:04.777445 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-97f3c2ea-b21f-4ec0-828b-246601180fc3 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0" status: 200 len: 287 microversion: 2.1 time: 0.036908 May 26 17:12:04.777839 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-819b4464-b340-46b6-82f9-cb39386ca642 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:04.778160 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 674/1373] 10.222.0.112 () {58 vars in 1255 bytes} [Thu May 26 17:12:04 2022] GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:12:04.785967 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-819b4464-b340-46b6-82f9-cb39386ca642 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1270 microversion: 2.1 time: 0.089154 May 26 17:12:04.786586 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 700/1374] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:04 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:04.788754 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-376c6184-8030-4a54-998d-68d6b60f374f tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd25139eaf0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:04.948479 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-376c6184-8030-4a54-998d-68d6b60f374f tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "DELETE /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0" status: 202 len: 0 microversion: 2.1 time: 0.163283 May 26 17:12:04.949047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 675/1375] 10.222.0.112 () {58 vars in 1258 bytes} [Thu May 26 17:12:04 2022] DELETE /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:12:04.958311 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2110f193-04bc-4db9-aeeb-4578225601aa tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd2562329d0>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:04.989033 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2110f193-04bc-4db9-aeeb-4578225601aa tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0" status: 200 len: 286 microversion: 2.1 time: 0.035567 May 26 17:12:04.989673 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 701/1376] 10.222.0.112 () {58 vars in 1255 bytes} [Thu May 26 17:12:04 2022] GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:05.256305 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6880d769-9a26-4fa8-87ea-f63e60443a74 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:05.256923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6880d769-9a26-4fa8-87ea-f63e60443a74 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:05.264771 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6880d769-9a26-4fa8-87ea-f63e60443a74 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:05.265223 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6880d769-9a26-4fa8-87ea-f63e60443a74 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:05.266723 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6880d769-9a26-4fa8-87ea-f63e60443a74 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:05.267175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6880d769-9a26-4fa8-87ea-f63e60443a74 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:05.410750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8f20e02f-b962-4979-9ecc-0ba4affe67d7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:05.411250 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8f20e02f-b962-4979-9ecc-0ba4affe67d7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:05.413274 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:05.418949 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8f20e02f-b962-4979-9ecc-0ba4affe67d7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:05.419401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8f20e02f-b962-4979-9ecc-0ba4affe67d7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:05.420236 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8f20e02f-b962-4979-9ecc-0ba4affe67d7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:05.420678 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8f20e02f-b962-4979-9ecc-0ba4affe67d7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:05.426201 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6880d769-9a26-4fa8-87ea-f63e60443a74 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:05.434724 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-8f20e02f-b962-4979-9ecc-0ba4affe67d7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] HTTP exception thrown: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:12:05.435056 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6880d769-9a26-4fa8-87ea-f63e60443a74 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1580 microversion: 2.1 time: 0.183891 May 26 17:12:05.435634 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 676/1377] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:05 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1580 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8f20e02f-b962-4979-9ecc-0ba4affe67d7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Request method failure captured: May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: DELETE /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 HTTP/1.1 May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7GbzCgiZk59vHpDkcrPHVdJ6eBbq3ZN7mPQ_jki-Cnud1ZGJE-hnmfeAREoNiozhYPx5WjZvvBOlx0pN1ljf7ZQUCIPRYf_PqV44iAX8UC9LpMuGLkK_1XlkWtyYk5MJCcD2hYoGIuHDXSqIRkN3MGkUjNbjXAC1anwqPwQkkH1r0Q May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Openstack-Nova-Api-Version: 2.20 May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 0c9ae847a0d449ab9c875f8a4f936d6a May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:12:05.436407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:12:05.437983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_0c9ae847a0d449ab9c875f8a4f936d6a"}]}] May 26 17:12:05.437983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:12:05.437983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 0c9ae847a0d449ab9c875f8a4f936d6a May 26 17:12:05.437983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:12:05.437983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-AttachVolumeShelveTestJSON-672346481-project May 26 17:12:05.437983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:12:05.437983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:12:05.437983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 9e09f6a92f064ec78231fa06782bafda May 26 17:12:05.437983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-AttachVolumeShelveTestJSON-672346481-project May 26 17:12:05.437983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:12:05.437983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:12:05.437983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '79e5f6d0-3136-4741-a4c4-916b792ee1c8'} May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:12:05.438816 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:12:05.440111 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:05.441479 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8f20e02f-b962-4979-9ecc-0ba4affe67d7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Returning 404 to user: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:12:05.441479 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8f20e02f-b962-4979-9ecc-0ba4affe67d7 tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "DELETE /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 404 len: 111 microversion: 2.20 time: 0.031165 May 26 17:12:05.441479 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 702/1378] 10.222.0.112 () {60 vars in 1284 bytes} [Thu May 26 17:12:05 2022] DELETE /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 17:12:05.447036 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1e25a5eb-d943-47f9-bc13-329ed63fad9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:05.447936 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-1e25a5eb-d943-47f9-bc13-329ed63fad9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] [instance: 79e5f6d0-3136-4741-a4c4-916b792ee1c8] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:05.454107 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1e25a5eb-d943-47f9-bc13-329ed63fad9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:05.454537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1e25a5eb-d943-47f9-bc13-329ed63fad9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:05.455354 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1e25a5eb-d943-47f9-bc13-329ed63fad9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:05.455795 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-1e25a5eb-d943-47f9-bc13-329ed63fad9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:05.469531 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-1e25a5eb-d943-47f9-bc13-329ed63fad9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] HTTP exception thrown: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1e25a5eb-d943-47f9-bc13-329ed63fad9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Request method failure captured: May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 HTTP/1.1 May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7GbzCgiZk59vHpDkcrPHVdJ6eBbq3ZN7mPQ_jki-Cnud1ZGJE-hnmfeAREoNiozhYPx5WjZvvBOlx0pN1ljf7ZQUCIPRYf_PqV44iAX8UC9LpMuGLkK_1XlkWtyYk5MJCcD2hYoGIuHDXSqIRkN3MGkUjNbjXAC1anwqPwQkkH1r0Q May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Openstack-Nova-Api-Version: 2.20 May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 0c9ae847a0d449ab9c875f8a4f936d6a May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:12:05.471205 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:12:05.472915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/0c9ae847a0d449ab9c875f8a4f936d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_0c9ae847a0d449ab9c875f8a4f936d6a"}]}] May 26 17:12:05.472915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:12:05.472915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 0c9ae847a0d449ab9c875f8a4f936d6a May 26 17:12:05.472915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-672346481 May 26 17:12:05.472915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-AttachVolumeShelveTestJSON-672346481-project May 26 17:12:05.472915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:12:05.472915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:12:05.472915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 9e09f6a92f064ec78231fa06782bafda May 26 17:12:05.472915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-AttachVolumeShelveTestJSON-672346481-project May 26 17:12:05.472915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:12:05.472915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:12:05.472915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': '79e5f6d0-3136-4741-a4c4-916b792ee1c8'} May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:12:05.473959 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. May 26 17:12:05.475346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:05.476778 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1e25a5eb-d943-47f9-bc13-329ed63fad9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] Returning 404 to user: Instance 79e5f6d0-3136-4741-a4c4-916b792ee1c8 could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:12:05.476778 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1e25a5eb-d943-47f9-bc13-329ed63fad9e tempest-AttachVolumeShelveTestJSON-672346481 tempest-AttachVolumeShelveTestJSON-672346481-project] 10.222.0.112 "GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8" status: 404 len: 111 microversion: 2.20 time: 0.029588 May 26 17:12:05.476778 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 677/1379] 10.222.0.112 () {60 vars in 1281 bytes} [Thu May 26 17:12:05 2022] GET /compute/v2.1/servers/79e5f6d0-3136-4741-a4c4-916b792ee1c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 17:12:05.803568 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d5c90496-1aa9-4e5d-a7a3-0b6c7d1e9eca tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:05.804096 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d5c90496-1aa9-4e5d-a7a3-0b6c7d1e9eca tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:05.812214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d5c90496-1aa9-4e5d-a7a3-0b6c7d1e9eca tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:05.812665 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d5c90496-1aa9-4e5d-a7a3-0b6c7d1e9eca tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:05.813633 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d5c90496-1aa9-4e5d-a7a3-0b6c7d1e9eca tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:05.814101 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d5c90496-1aa9-4e5d-a7a3-0b6c7d1e9eca tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:05.906686 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d5c90496-1aa9-4e5d-a7a3-0b6c7d1e9eca tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:05.915048 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d5c90496-1aa9-4e5d-a7a3-0b6c7d1e9eca tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1270 microversion: 2.1 time: 0.115387 May 26 17:12:05.915658 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 703/1380] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:05 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:06.000999 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4aa9307e-c589-47f5-852a-1b2adc0bbbeb tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd250fb9b80>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:06.027638 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-4aa9307e-c589-47f5-852a-1b2adc0bbbeb tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] HTTP exception thrown: Snapshot 05513396-04a8-482a-b626-86b5d9cbaff0 could not be found. May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4aa9307e-c589-47f5-852a-1b2adc0bbbeb tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Request method failure captured: May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0 HTTP/1.1 May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7Ta3GUQ-DTeTUdYEp4L13kGFxxn_YX-LQzkPbOjdGg4CYoGSJWn5LrVX9vOwn-kV_CIKs5xnRNOBO4f77KuBq3aITrRAEbEShOz7VO-Dj8a2BqfDO6pWJpqXc7kTghT8TSYC3Jnvzug1zs9BzJW3Rz4XHU6bRozGJk9aCx90U5d0-4 May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 32d9c3c9c417461aa8c4cbf1752e33a0 May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2052801752 May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:12:06.030034 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/32d9c3c9c417461aa8c4cbf1752e33a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/32d9c3c9c417461aa8c4cbf1752e33a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/32d9c3c9c417461aa8c4cbf1752e33a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_32d9c3c9c417461aa8c4cbf1752e33a0"}]}] May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2052801752 May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 32d9c3c9c417461aa8c4cbf1752e33a0 May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2052801752 May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-VolumesSnapshotsTestJSON-2052801752-project May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 7289f3e9da4e48d9b85e15a2b6f00f59 May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2052801752-project May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Snapshot 05513396-04a8-482a-b626-86b5d9cbaff0 could not be found. May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': '05513396-04a8-482a-b626-86b5d9cbaff0'} May 26 17:12:06.031561 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 05513396-04a8-482a-b626-86b5d9cbaff0 could not be found. (HTTP 404) (Request-ID: req-a2f9473d-c885-4706-b249-f1b0c40488a3) May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:06.032502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:12:06.034622 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 05513396-04a8-482a-b626-86b5d9cbaff0 could not be found. May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 17:12:06.037244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 05513396-04a8-482a-b626-86b5d9cbaff0 could not be found. May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 05513396-04a8-482a-b626-86b5d9cbaff0 could not be found. May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4aa9307e-c589-47f5-852a-1b2adc0bbbeb tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Returning 404 to user: Snapshot 05513396-04a8-482a-b626-86b5d9cbaff0 could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:12:06.039374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4aa9307e-c589-47f5-852a-1b2adc0bbbeb tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0" status: 404 len: 111 microversion: 2.1 time: 0.034808 May 26 17:12:06.040399 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 678/1381] 10.222.0.112 () {58 vars in 1255 bytes} [Thu May 26 17:12:05 2022] GET /compute/v2.1/os-snapshots/05513396-04a8-482a-b626-86b5d9cbaff0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:12:06.042456 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-78845b83-8c2b-461d-a74c-a00e2b4b1204 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd250db01f0>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:06.297424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-78845b83-8c2b-461d-a74c-a00e2b4b1204 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "DELETE /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8" status: 202 len: 0 microversion: 2.1 time: 0.260388 May 26 17:12:06.298461 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 704/1382] 10.222.0.112 () {58 vars in 1252 bytes} [Thu May 26 17:12:06 2022] DELETE /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:12:06.308651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-c4e89f8a-4409-4a28-92c8-bb1561edf984 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd25621a790>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:06.370180 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-c4e89f8a-4409-4a28-92c8-bb1561edf984 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8" status: 200 len: 343 microversion: 2.1 time: 0.066710 May 26 17:12:06.371081 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 679/1383] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:06 2022] GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8 => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:06.453208 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-aefc3b69-7487-4d77-a1cc-7975b6010dac tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:06.454215 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-aefc3b69-7487-4d77-a1cc-7975b6010dac tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:06.460516 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aefc3b69-7487-4d77-a1cc-7975b6010dac tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:06.461189 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aefc3b69-7487-4d77-a1cc-7975b6010dac tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:06.461714 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aefc3b69-7487-4d77-a1cc-7975b6010dac tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:06.462146 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aefc3b69-7487-4d77-a1cc-7975b6010dac tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:06.737164 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-aefc3b69-7487-4d77-a1cc-7975b6010dac tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:06.753084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-aefc3b69-7487-4d77-a1cc-7975b6010dac tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1580 microversion: 2.1 time: 0.303672 May 26 17:12:06.754447 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 705/1384] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:06 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1580 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:06.933481 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-32e44fce-99a1-4988-ae17-dba058bad79c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:06.934276 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-32e44fce-99a1-4988-ae17-dba058bad79c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:06.940915 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-32e44fce-99a1-4988-ae17-dba058bad79c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:06.941639 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-32e44fce-99a1-4988-ae17-dba058bad79c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:06.943000 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-32e44fce-99a1-4988-ae17-dba058bad79c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:06.943533 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-32e44fce-99a1-4988-ae17-dba058bad79c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:07.057709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-32e44fce-99a1-4988-ae17-dba058bad79c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:07.066620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-32e44fce-99a1-4988-ae17-dba058bad79c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1276 microversion: 2.1 time: 0.137552 May 26 17:12:07.070576 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 680/1385] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:06 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:07.387452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dfa08e47-2f44-41e4-bdf4-4d875c47e81d tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd250db0820>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:07.469903 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-dfa08e47-2f44-41e4-bdf4-4d875c47e81d tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] HTTP exception thrown: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dfa08e47-2f44-41e4-bdf4-4d875c47e81d tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Request method failure captured: May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8 HTTP/1.1 May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7Ta3GUQ-DTeTUdYEp4L13kGFxxn_YX-LQzkPbOjdGg4CYoGSJWn5LrVX9vOwn-kV_CIKs5xnRNOBO4f77KuBq3aITrRAEbEShOz7VO-Dj8a2BqfDO6pWJpqXc7kTghT8TSYC3Jnvzug1zs9BzJW3Rz4XHU6bRozGJk9aCx90U5d0-4 May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: 32d9c3c9c417461aa8c4cbf1752e33a0 May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2052801752 May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:12:07.472186 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/32d9c3c9c417461aa8c4cbf1752e33a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/32d9c3c9c417461aa8c4cbf1752e33a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/32d9c3c9c417461aa8c4cbf1752e33a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_32d9c3c9c417461aa8c4cbf1752e33a0"}]}] May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2052801752 May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: 32d9c3c9c417461aa8c4cbf1752e33a0 May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2052801752 May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-VolumesSnapshotsTestJSON-2052801752-project May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 7289f3e9da4e48d9b85e15a2b6f00f59 May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2052801752-project May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'da0108f7-980c-4e0a-97ef-46cf2caa8ca8'} May 26 17:12:07.473902 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. (HTTP 404) (Request-ID: req-6df08b87-211b-4cbd-9026-5934db180421) May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:07.475001 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:12:07.476912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 17:12:07.478885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:12:07.480307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.480307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:07.480307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:07.480307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:07.480307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:07.480307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:07.480307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:07.480307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:12:07.480307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:12:07.480307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.480307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:07.483014 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dfa08e47-2f44-41e4-bdf4-4d875c47e81d tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Returning 404 to user: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:12:07.484516 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-dfa08e47-2f44-41e4-bdf4-4d875c47e81d tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8" status: 404 len: 109 microversion: 2.1 time: 0.104120 May 26 17:12:07.494201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 706/1386] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:07 2022] GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:12:07.501628 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1bc9d8af-dc3c-4f36-b956-c067008ca82b tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd2562211f0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:07.541494 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-65f488f7-12fe-4a53-a4e2-b41991ac31ec req-d94cf27c-9d31-4886-a5f6-2de1b048c7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674dca1d-7dd2-42f4-8ddc-f9742a6d688d", "name": "network-vif-deleted", "tag": "0ca04129-6455-4066-a7dd-a0f93617531c"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:12:07.544059 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-1bc9d8af-dc3c-4f36-b956-c067008ca82b tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] HTTP exception thrown: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1bc9d8af-dc3c-4f36-b956-c067008ca82b tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Request method failure captured: May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: DELETE /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8 HTTP/1.1 May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7Ta3GUQ-DTeTUdYEp4L13kGFxxn_YX-LQzkPbOjdGg4CYoGSJWn5LrVX9vOwn-kV_CIKs5xnRNOBO4f77KuBq3aITrRAEbEShOz7VO-Dj8a2BqfDO6pWJpqXc7kTghT8TSYC3Jnvzug1zs9BzJW3Rz4XHU6bRozGJk9aCx90U5d0-4 May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 32d9c3c9c417461aa8c4cbf1752e33a0 May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2052801752 May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:12:07.546575 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/32d9c3c9c417461aa8c4cbf1752e33a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/32d9c3c9c417461aa8c4cbf1752e33a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/32d9c3c9c417461aa8c4cbf1752e33a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_32d9c3c9c417461aa8c4cbf1752e33a0"}]}] May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2052801752 May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 32d9c3c9c417461aa8c4cbf1752e33a0 May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2052801752 May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-VolumesSnapshotsTestJSON-2052801752-project May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 7289f3e9da4e48d9b85e15a2b6f00f59 May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2052801752-project May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': 'da0108f7-980c-4e0a-97ef-46cf2caa8ca8'} May 26 17:12:07.548328 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. (HTTP 404) (Request-ID: req-0790f5c3-1a31-42f6-b125-beaafb01c358) May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:07.549319 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 17:12:07.553297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 17:12:07.554925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1bc9d8af-dc3c-4f36-b956-c067008ca82b tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Returning 404 to user: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:12:07.557517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1bc9d8af-dc3c-4f36-b956-c067008ca82b tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "DELETE /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8" status: 404 len: 109 microversion: 2.1 time: 0.052331 May 26 17:12:07.558605 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 681/1387] 10.222.0.112 () {58 vars in 1252 bytes} [Thu May 26 17:12:07 2022] DELETE /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:12:07.559099 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-65f488f7-12fe-4a53-a4e2-b41991ac31ec req-d94cf27c-9d31-4886-a5f6-2de1b048c7d7 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:07.559560 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-65f488f7-12fe-4a53-a4e2-b41991ac31ec req-d94cf27c-9d31-4886-a5f6-2de1b048c7d7 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:07.562811 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ad76b7bc-f521-4258-a0fb-dd9abbed9bc7 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Calling method '.version_select at 0x7fd2513b39d0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:07.592009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-65f488f7-12fe-4a53-a4e2-b41991ac31ec req-d94cf27c-9d31-4886-a5f6-2de1b048c7d7 service nova] Creating event network-vif-deleted:0ca04129-6455-4066-a7dd-a0f93617531c for instance 674dca1d-7dd2-42f4-8ddc-f9742a6d688d on hv-cinder-83607 May 26 17:12:07.606735 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-65f488f7-12fe-4a53-a4e2-b41991ac31ec req-d94cf27c-9d31-4886-a5f6-2de1b048c7d7 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068890 May 26 17:12:07.607934 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 707/1388] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:07.610305 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-ad76b7bc-f521-4258-a0fb-dd9abbed9bc7 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] HTTP exception thrown: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ad76b7bc-f521-4258-a0fb-dd9abbed9bc7 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Request method failure captured: May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8 HTTP/1.1 May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7Ta3GUQ-DTeTUdYEp4L13kGFxxn_YX-LQzkPbOjdGg4CYoGSJWn5LrVX9vOwn-kV_CIKs5xnRNOBO4f77KuBq3aITrRAEbEShOz7VO-Dj8a2BqfDO6pWJpqXc7kTghT8TSYC3Jnvzug1zs9BzJW3Rz4XHU6bRozGJk9aCx90U5d0-4 May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 32d9c3c9c417461aa8c4cbf1752e33a0 May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2052801752 May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:12:07.610893 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/32d9c3c9c417461aa8c4cbf1752e33a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/32d9c3c9c417461aa8c4cbf1752e33a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/32d9c3c9c417461aa8c4cbf1752e33a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_32d9c3c9c417461aa8c4cbf1752e33a0"}]}] May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2052801752 May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 32d9c3c9c417461aa8c4cbf1752e33a0 May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2052801752 May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-VolumesSnapshotsTestJSON-2052801752-project May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 7289f3e9da4e48d9b85e15a2b6f00f59 May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2052801752-project May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': 'da0108f7-980c-4e0a-97ef-46cf2caa8ca8'} May 26 17:12:07.612467 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. (HTTP 404) (Request-ID: req-126cf8cd-7977-4e21-8bf3-ed6a0fa1ff12) May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:07.613413 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:12:07.614877 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 17:12:07.616267 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ad76b7bc-f521-4258-a0fb-dd9abbed9bc7 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] Returning 404 to user: Volume da0108f7-980c-4e0a-97ef-46cf2caa8ca8 could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ad76b7bc-f521-4258-a0fb-dd9abbed9bc7 tempest-VolumesSnapshotsTestJSON-2052801752 tempest-VolumesSnapshotsTestJSON-2052801752-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8" status: 404 len: 109 microversion: 2.1 time: 0.056261 May 26 17:12:07.617651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 682/1389] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:07 2022] GET /compute/v2.1/os-volumes/da0108f7-980c-4e0a-97ef-46cf2caa8ca8 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:12:07.777865 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-32d95d2d-cdb5-455d-9697-2f650b7edb22 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:07.778519 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-32d95d2d-cdb5-455d-9697-2f650b7edb22 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:07.797133 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-32d95d2d-cdb5-455d-9697-2f650b7edb22 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:07.800381 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-32d95d2d-cdb5-455d-9697-2f650b7edb22 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:07.801703 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-32d95d2d-cdb5-455d-9697-2f650b7edb22 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:07.802519 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-32d95d2d-cdb5-455d-9697-2f650b7edb22 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:07.922493 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-32d95d2d-cdb5-455d-9697-2f650b7edb22 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:07.933704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-32d95d2d-cdb5-455d-9697-2f650b7edb22 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1229 microversion: 2.1 time: 0.164883 May 26 17:12:07.943127 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 708/1390] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:07 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1229 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:08.088072 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e89a43b8-de49-4ef3-b56d-d30ec02ee478 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:08.088728 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e89a43b8-de49-4ef3-b56d-d30ec02ee478 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:08.095855 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e89a43b8-de49-4ef3-b56d-d30ec02ee478 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:08.096571 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e89a43b8-de49-4ef3-b56d-d30ec02ee478 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:08.097664 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e89a43b8-de49-4ef3-b56d-d30ec02ee478 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:08.098674 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e89a43b8-de49-4ef3-b56d-d30ec02ee478 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:08.386657 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e89a43b8-de49-4ef3-b56d-d30ec02ee478 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:08.399432 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e89a43b8-de49-4ef3-b56d-d30ec02ee478 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.316815 May 26 17:12:08.401502 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 683/1391] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:08 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:08.952143 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-504771de-a081-4d78-85f2-f768bc3c9d19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:08.952773 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-504771de-a081-4d78-85f2-f768bc3c9d19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:08.959938 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-504771de-a081-4d78-85f2-f768bc3c9d19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:08.964660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-504771de-a081-4d78-85f2-f768bc3c9d19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:08.964660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-504771de-a081-4d78-85f2-f768bc3c9d19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:08.964660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-504771de-a081-4d78-85f2-f768bc3c9d19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:08.995015 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-504771de-a081-4d78-85f2-f768bc3c9d19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:08.995499 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-504771de-a081-4d78-85f2-f768bc3c9d19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:08.996011 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-504771de-a081-4d78-85f2-f768bc3c9d19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lazy-loading 'fault' on Instance uuid 674dca1d-7dd2-42f4-8ddc-f9742a6d688d {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:12:09.038614 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-504771de-a081-4d78-85f2-f768bc3c9d19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:09.046425 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-504771de-a081-4d78-85f2-f768bc3c9d19 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 200 len: 1234 microversion: 2.1 time: 0.099464 May 26 17:12:09.047009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 709/1392] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:08 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 1234 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:09.418379 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f490af37-1f09-4024-b94e-fb16610d6cc8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:09.419265 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f490af37-1f09-4024-b94e-fb16610d6cc8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:09.421454 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:09.422419 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=6 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:09.429062 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f490af37-1f09-4024-b94e-fb16610d6cc8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:09.434923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f490af37-1f09-4024-b94e-fb16610d6cc8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:09.434923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f490af37-1f09-4024-b94e-fb16610d6cc8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:09.434923 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f490af37-1f09-4024-b94e-fb16610d6cc8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:09.627694 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-d3735c35-7e18-48e8-8af5-1679952e8052 req-a0b66444-bc4d-4446-8a38-f6e86233d193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ca9033-7531-4f09-83d8-71827ca52adf", "tag": "6656dd72-a374-47eb-a01e-f0460c7708eb"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:12:09.640173 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-d3735c35-7e18-48e8-8af5-1679952e8052 req-a0b66444-bc4d-4446-8a38-f6e86233d193 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:09.640853 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-d3735c35-7e18-48e8-8af5-1679952e8052 req-a0b66444-bc4d-4446-8a38-f6e86233d193 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:09.655503 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-d3735c35-7e18-48e8-8af5-1679952e8052 req-a0b66444-bc4d-4446-8a38-f6e86233d193 service nova] Creating event network-changed:6656dd72-a374-47eb-a01e-f0460c7708eb for instance a1ca9033-7531-4f09-83d8-71827ca52adf on hv-cinder-83607 May 26 17:12:09.661227 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-d3735c35-7e18-48e8-8af5-1679952e8052 req-a0b66444-bc4d-4446-8a38-f6e86233d193 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037883 May 26 17:12:09.662479 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 710/1393] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:12:09.787992 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f490af37-1f09-4024-b94e-fb16610d6cc8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:09.797057 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f490af37-1f09-4024-b94e-fb16610d6cc8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.383640 May 26 17:12:09.800242 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 684/1394] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:09 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:10.065323 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-aa117151-b4ac-4590-b4af-b93445942809 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:10.066012 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-aa117151-b4ac-4590-b4af-b93445942809 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 674dca1d-7dd2-42f4-8ddc-f9742a6d688d] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:10.075864 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aa117151-b4ac-4590-b4af-b93445942809 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:10.076321 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aa117151-b4ac-4590-b4af-b93445942809 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:10.077090 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aa117151-b4ac-4590-b4af-b93445942809 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:10.077527 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aa117151-b4ac-4590-b4af-b93445942809 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:10.094820 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-aa117151-b4ac-4590-b4af-b93445942809 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] HTTP exception thrown: Instance 674dca1d-7dd2-42f4-8ddc-f9742a6d688d could not be found. May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-aa117151-b4ac-4590-b4af-b93445942809 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Request method failure captured: May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d HTTP/1.1 May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7IWC8FDQR8r2fIIzzAh7BnRmXOYTh4TWSi0hcJ3C6yH5-H8Yla95yIAVFbiY-FAeNYP0fd5p4xGPd5NUxO7uBbvRLPQc5L4nza_JFBSotvduni7sabuzDZLyUBQoPF2f0dju-fOVjTC3xl-k0JMYoRxkKq54rqAN1lLGU5dsBoGc4k May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: ed4f536fcafe46b5ae159b93acb7e041 May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-TestVolumeBootPattern-862722930 May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:12:10.096473 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:12:10.098220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_ed4f536fcafe46b5ae159b93acb7e041"}]}] May 26 17:12:10.098220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-TestVolumeBootPattern-862722930 May 26 17:12:10.098220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: ed4f536fcafe46b5ae159b93acb7e041 May 26 17:12:10.098220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-TestVolumeBootPattern-862722930 May 26 17:12:10.098220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-TestVolumeBootPattern-862722930-project May 26 17:12:10.098220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:12:10.098220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:12:10.098220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 530b2b1951644755afd1432381cf37f9 May 26 17:12:10.098220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-TestVolumeBootPattern-862722930-project May 26 17:12:10.098220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:12:10.098220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 674dca1d-7dd2-42f4-8ddc-f9742a6d688d could not be found. May 26 17:12:10.098220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '674dca1d-7dd2-42f4-8ddc-f9742a6d688d'} May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674dca1d-7dd2-42f4-8ddc-f9742a6d688d could not be found. May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:12:10.099424 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674dca1d-7dd2-42f4-8ddc-f9742a6d688d could not be found. May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674dca1d-7dd2-42f4-8ddc-f9742a6d688d could not be found. May 26 17:12:10.100979 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:10.103962 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-aa117151-b4ac-4590-b4af-b93445942809 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Returning 404 to user: Instance 674dca1d-7dd2-42f4-8ddc-f9742a6d688d could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:12:10.103962 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-aa117151-b4ac-4590-b4af-b93445942809 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d" status: 404 len: 111 microversion: 2.1 time: 0.037482 May 26 17:12:10.103962 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 711/1395] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:10 2022] GET /compute/v2.1/servers/674dca1d-7dd2-42f4-8ddc-f9742a6d688d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:12:10.591173 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-996cb846-c852-4d65-99de-3297c662d32b tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] Action: 'create', calling method: .version_select at 0x7fd25621a0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1433322863", "metadata": {"Type": "work"}}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:12:10.815896 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2cbe1330-016d-4c5d-9a99-1c65e627aeac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:10.816504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2cbe1330-016d-4c5d-9a99-1c65e627aeac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:10.818550 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=4 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:10.824407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2cbe1330-016d-4c5d-9a99-1c65e627aeac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:10.824792 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2cbe1330-016d-4c5d-9a99-1c65e627aeac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:10.825551 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2cbe1330-016d-4c5d-9a99-1c65e627aeac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:10.825981 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2cbe1330-016d-4c5d-9a99-1c65e627aeac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:10.968100 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-2cbe1330-016d-4c5d-9a99-1c65e627aeac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:10.975564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2cbe1330-016d-4c5d-9a99-1c65e627aeac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.163528 May 26 17:12:10.976127 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 712/1396] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:10 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:12:11.454049 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-996cb846-c852-4d65-99de-3297c662d32b tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] 10.222.0.112 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.985596 May 26 17:12:11.454903 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 685/1397] 10.222.0.112 () {60 vars in 1160 bytes} [Thu May 26 17:12:10 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 987 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) May 26 17:12:11.466614 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-73940c36-8475-4047-b4b5-13ab5f890116 tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] Calling method '.version_select at 0x7fd2562323a0>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:11.518100 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-73940c36-8475-4047-b4b5-13ab5f890116 tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95" status: 200 len: 353 microversion: 2.1 time: 0.055591 May 26 17:12:11.518731 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 713/1398] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:11 2022] GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:11.993093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d6819649-a8af-4bbc-bd85-d1cb1912d88d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:11.993696 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d6819649-a8af-4bbc-bd85-d1cb1912d88d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:12.000427 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d6819649-a8af-4bbc-bd85-d1cb1912d88d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:12.009023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d6819649-a8af-4bbc-bd85-d1cb1912d88d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:12.009023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d6819649-a8af-4bbc-bd85-d1cb1912d88d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:12.009023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d6819649-a8af-4bbc-bd85-d1cb1912d88d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:12.130992 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d6819649-a8af-4bbc-bd85-d1cb1912d88d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:12.138838 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d6819649-a8af-4bbc-bd85-d1cb1912d88d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.150234 May 26 17:12:12.139405 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 686/1399] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:11 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:12.531598 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f2789979-8252-4be7-9ac8-3250928b7405 tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] Calling method '.version_select at 0x7fd256233e50>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:12.580913 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f2789979-8252-4be7-9ac8-3250928b7405 tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95" status: 200 len: 353 microversion: 2.1 time: 0.053734 May 26 17:12:12.581736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 714/1400] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:12 2022] GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:13.155866 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a0110ce1-1bdd-4312-843a-05ec1833dd32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:13.156481 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a0110ce1-1bdd-4312-843a-05ec1833dd32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:13.163408 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a0110ce1-1bdd-4312-843a-05ec1833dd32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:13.163869 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a0110ce1-1bdd-4312-843a-05ec1833dd32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:13.164636 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a0110ce1-1bdd-4312-843a-05ec1833dd32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:13.165096 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a0110ce1-1bdd-4312-843a-05ec1833dd32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:13.306570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a0110ce1-1bdd-4312-843a-05ec1833dd32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:13.314610 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a0110ce1-1bdd-4312-843a-05ec1833dd32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.162493 May 26 17:12:13.318190 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 687/1401] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:13 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:13.606132 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-23800b9c-8874-404f-a446-cc901b06d475 tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] Calling method '.version_select at 0x7fd25623dc10>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:13.678735 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-23800b9c-8874-404f-a446-cc901b06d475 tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95" status: 200 len: 353 microversion: 2.1 time: 0.077745 May 26 17:12:13.679564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 715/1402] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:13 2022] GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95 => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:14.334314 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-13fe13dc-6b9e-46ca-b99c-e9aa0ed751a6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:14.335409 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-13fe13dc-6b9e-46ca-b99c-e9aa0ed751a6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:14.343223 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-13fe13dc-6b9e-46ca-b99c-e9aa0ed751a6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:14.343838 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-13fe13dc-6b9e-46ca-b99c-e9aa0ed751a6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:14.344778 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-13fe13dc-6b9e-46ca-b99c-e9aa0ed751a6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:14.345344 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-13fe13dc-6b9e-46ca-b99c-e9aa0ed751a6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:14.551635 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-61acb249-5955-4ef3-9d4c-2d57fa1babf8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:14.552138 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-61acb249-5955-4ef3-9d4c-2d57fa1babf8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:14.559952 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-61acb249-5955-4ef3-9d4c-2d57fa1babf8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:14.560741 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-61acb249-5955-4ef3-9d4c-2d57fa1babf8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:14.561662 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-61acb249-5955-4ef3-9d4c-2d57fa1babf8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:14.562263 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-61acb249-5955-4ef3-9d4c-2d57fa1babf8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:14.591619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-61acb249-5955-4ef3-9d4c-2d57fa1babf8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Going to try to terminate instance {{(pid=130526) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:12:14.699457 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-13fe13dc-6b9e-46ca-b99c-e9aa0ed751a6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:14.711955 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-13fe13dc-6b9e-46ca-b99c-e9aa0ed751a6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.381975 May 26 17:12:14.713809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 688/1403] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:14 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:14.718777 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-f7aa220f-ae2b-44ad-89e6-c32dc9fc29c3 req-a2dc9085-a172-43b0-9716-2435804d64c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8949ea8b-a66a-4c3d-a048-3020e3d8b7f9", "tag": "c3bb5511-a235-4369-a160-73fb0904cf14"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:12:14.727545 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-f7aa220f-ae2b-44ad-89e6-c32dc9fc29c3 req-a2dc9085-a172-43b0-9716-2435804d64c1 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:14.728584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-f7aa220f-ae2b-44ad-89e6-c32dc9fc29c3 req-a2dc9085-a172-43b0-9716-2435804d64c1 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:14.741593 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-f7aa220f-ae2b-44ad-89e6-c32dc9fc29c3 req-a2dc9085-a172-43b0-9716-2435804d64c1 service nova] Creating event network-changed:c3bb5511-a235-4369-a160-73fb0904cf14 for instance 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 on hv-cinder-83607 May 26 17:12:14.749167 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-f7aa220f-ae2b-44ad-89e6-c32dc9fc29c3 req-a2dc9085-a172-43b0-9716-2435804d64c1 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033292 May 26 17:12:14.750816 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 689/1404] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:14.758741 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cb795eba-0fce-4603-8bc0-98983a3231d9 tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] Calling method '.version_select at 0x7fd25139e550>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:14.813084 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cb795eba-0fce-4603-8bc0-98983a3231d9 tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95" status: 200 len: 354 microversion: 2.1 time: 0.060889 May 26 17:12:14.813764 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 690/1405] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:14 2022] GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95 => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:14.826690 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d497cf05-ad7c-40d0-8a5f-a68b7d78bb70 tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] Calling method '.version_select at 0x7fd25621a8b0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:14.888488 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d497cf05-ad7c-40d0-8a5f-a68b7d78bb70 tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95" status: 200 len: 354 microversion: 2.1 time: 0.067011 May 26 17:12:14.896265 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 691/1406] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:14 2022] GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95 => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:14.901790 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6dd17620-ceec-431b-b39c-86e5806e1e9d tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] Calling method '.version_select at 0x7fd2510570d0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:14.937899 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-61acb249-5955-4ef3-9d4c-2d57fa1babf8 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "DELETE /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 204 len: 0 microversion: 2.1 time: 0.389210 May 26 17:12:14.940260 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 716/1407] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:12:14 2022] DELETE /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:12:14.955528 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-92d64b1e-acff-47c5-a6f4-f8fbccf1d16a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:14.956591 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-92d64b1e-acff-47c5-a6f4-f8fbccf1d16a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:14.963462 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-92d64b1e-acff-47c5-a6f4-f8fbccf1d16a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:14.964214 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-92d64b1e-acff-47c5-a6f4-f8fbccf1d16a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:14.965326 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-92d64b1e-acff-47c5-a6f4-f8fbccf1d16a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:14.965826 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-92d64b1e-acff-47c5-a6f4-f8fbccf1d16a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:15.111117 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-92d64b1e-acff-47c5-a6f4-f8fbccf1d16a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:15.119501 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-92d64b1e-acff-47c5-a6f4-f8fbccf1d16a tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1581 microversion: 2.1 time: 0.167972 May 26 17:12:15.120078 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 717/1408] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:14 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1581 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:12:15.176665 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6dd17620-ceec-431b-b39c-86e5806e1e9d tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] 10.222.0.112 "DELETE /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95" status: 202 len: 0 microversion: 2.1 time: 0.279047 May 26 17:12:15.182062 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 692/1409] 10.222.0.112 () {58 vars in 1252 bytes} [Thu May 26 17:12:14 2022] DELETE /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:12:15.187391 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-96abd899-f504-485e-9cc7-319d29a48794 tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] Calling method '.version_select at 0x7fd250db01f0>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:15.240076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-96abd899-f504-485e-9cc7-319d29a48794 tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95" status: 200 len: 353 microversion: 2.1 time: 0.056636 May 26 17:12:15.240934 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 718/1410] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:15 2022] GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:15.731161 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-6cc94064-50fa-4120-ba1f-d175109e5ed1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:15.731909 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-6cc94064-50fa-4120-ba1f-d175109e5ed1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:15.738652 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6cc94064-50fa-4120-ba1f-d175109e5ed1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:15.739082 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6cc94064-50fa-4120-ba1f-d175109e5ed1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:15.740026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6cc94064-50fa-4120-ba1f-d175109e5ed1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:15.740468 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-6cc94064-50fa-4120-ba1f-d175109e5ed1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:15.886146 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-6cc94064-50fa-4120-ba1f-d175109e5ed1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:15.893977 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-6cc94064-50fa-4120-ba1f-d175109e5ed1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.167616 May 26 17:12:15.896628 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 693/1411] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:15 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:16.137517 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-41d6de45-ad3c-40d9-98a2-8d178f54fccc tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:16.138240 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-41d6de45-ad3c-40d9-98a2-8d178f54fccc tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:16.144547 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41d6de45-ad3c-40d9-98a2-8d178f54fccc tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:16.144997 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41d6de45-ad3c-40d9-98a2-8d178f54fccc tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:16.145797 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41d6de45-ad3c-40d9-98a2-8d178f54fccc tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:16.146231 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41d6de45-ad3c-40d9-98a2-8d178f54fccc tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:16.253061 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3ad6a3e7-9d7b-47d9-8538-a46d571b1fac tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] Calling method '.version_select at 0x7fd251042dc0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:16.312277 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-3ad6a3e7-9d7b-47d9-8538-a46d571b1fac tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] HTTP exception thrown: Volume baa40626-434a-42c0-886c-5e92b1609e95 could not be found. May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3ad6a3e7-9d7b-47d9-8538-a46d571b1fac tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] Request method failure captured: May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95 HTTP/1.1 May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7Tq0G1-74tqWs0PKf-kp95Qg0Babuas4c73qzIfhlWDhZg1RnWFO3T-_uKv95Xh5HkAclTjaMgyND1mCIplOQ94v90XWT3hqk2PbKnwwN1zX7PxIK-Omz76nLw9rsxGQZyO5JS3O_iB-67xZOD_wbLYG_34Wg0s_csdF_SBE2K2Lv0 May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 7c07e2c3a7254cd78ab18e657d999f51 May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-VolumesGetTestJSON-1925311655 May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:12:16.315300 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/7c07e2c3a7254cd78ab18e657d999f51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/7c07e2c3a7254cd78ab18e657d999f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/7c07e2c3a7254cd78ab18e657d999f51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_7c07e2c3a7254cd78ab18e657d999f51"}]}] May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-VolumesGetTestJSON-1925311655 May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 7c07e2c3a7254cd78ab18e657d999f51 May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-VolumesGetTestJSON-1925311655 May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-VolumesGetTestJSON-1925311655-project May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 53bd77b0c09f422f94bcc1b85a588eb9 May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-VolumesGetTestJSON-1925311655-project May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Volume baa40626-434a-42c0-886c-5e92b1609e95 could not be found. May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': 'baa40626-434a-42c0-886c-5e92b1609e95'} May 26 17:12:16.316920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume baa40626-434a-42c0-886c-5e92b1609e95 could not be found. (HTTP 404) (Request-ID: req-8e58d03a-c845-4d75-a0ca-89db52950109) May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:16.317939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:12:16.319383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume baa40626-434a-42c0-886c-5e92b1609e95 could not be found. May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 17:12:16.321530 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:12:16.323022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume baa40626-434a-42c0-886c-5e92b1609e95 could not be found. May 26 17:12:16.323022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:16.323022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:16.323022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:16.323022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:16.323022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:16.323022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:16.323022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:12:16.323022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:12:16.323022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume baa40626-434a-42c0-886c-5e92b1609e95 could not be found. May 26 17:12:16.323022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:16.325114 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3ad6a3e7-9d7b-47d9-8538-a46d571b1fac tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] Returning 404 to user: Volume baa40626-434a-42c0-886c-5e92b1609e95 could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:12:16.326147 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3ad6a3e7-9d7b-47d9-8538-a46d571b1fac tempest-VolumesGetTestJSON-1925311655 tempest-VolumesGetTestJSON-1925311655-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95" status: 404 len: 109 microversion: 2.1 time: 0.076938 May 26 17:12:16.326935 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-41d6de45-ad3c-40d9-98a2-8d178f54fccc tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:16.327435 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 694/1412] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:16 2022] GET /compute/v2.1/os-volumes/baa40626-434a-42c0-886c-5e92b1609e95 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:12:16.341117 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-41d6de45-ad3c-40d9-98a2-8d178f54fccc tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1462 microversion: 2.1 time: 0.207836 May 26 17:12:16.341750 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 719/1413] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:16 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1462 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:16.802586 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-5c576389-7668-4b77-b031-4b974fcf7210 req-7908a2ec-9a1d-49b2-aef3-0d8a8a88ef9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8949ea8b-a66a-4c3d-a048-3020e3d8b7f9", "name": "network-vif-deleted", "tag": "c3bb5511-a235-4369-a160-73fb0904cf14"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:12:16.812583 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-5c576389-7668-4b77-b031-4b974fcf7210 req-7908a2ec-9a1d-49b2-aef3-0d8a8a88ef9c service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:16.813090 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-5c576389-7668-4b77-b031-4b974fcf7210 req-7908a2ec-9a1d-49b2-aef3-0d8a8a88ef9c service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:16.824287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-5c576389-7668-4b77-b031-4b974fcf7210 req-7908a2ec-9a1d-49b2-aef3-0d8a8a88ef9c service nova] Creating event network-vif-deleted:c3bb5511-a235-4369-a160-73fb0904cf14 for instance 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 on hv-cinder-83607 May 26 17:12:16.829286 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-5c576389-7668-4b77-b031-4b974fcf7210 req-7908a2ec-9a1d-49b2-aef3-0d8a8a88ef9c service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030868 May 26 17:12:16.829941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 695/1414] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:16.911304 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-30d3ddcd-b8ae-4011-9d22-52be75d84231 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:16.912415 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-30d3ddcd-b8ae-4011-9d22-52be75d84231 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:16.919963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30d3ddcd-b8ae-4011-9d22-52be75d84231 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:16.920407 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30d3ddcd-b8ae-4011-9d22-52be75d84231 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:16.926464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30d3ddcd-b8ae-4011-9d22-52be75d84231 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:16.926464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-30d3ddcd-b8ae-4011-9d22-52be75d84231 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:17.097725 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-30d3ddcd-b8ae-4011-9d22-52be75d84231 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:17.108578 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-30d3ddcd-b8ae-4011-9d22-52be75d84231 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.201172 May 26 17:12:17.109576 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 720/1415] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:16 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:17.359429 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-cf0db4a5-7956-4eff-9bcc-48fba42f8829 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:17.360188 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-cf0db4a5-7956-4eff-9bcc-48fba42f8829 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:17.366383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf0db4a5-7956-4eff-9bcc-48fba42f8829 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:17.366841 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf0db4a5-7956-4eff-9bcc-48fba42f8829 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:17.367608 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf0db4a5-7956-4eff-9bcc-48fba42f8829 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:17.368037 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-cf0db4a5-7956-4eff-9bcc-48fba42f8829 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:17.444881 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-cf0db4a5-7956-4eff-9bcc-48fba42f8829 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:17.453641 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-cf0db4a5-7956-4eff-9bcc-48fba42f8829 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1228 microversion: 2.1 time: 0.098335 May 26 17:12:17.455993 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 696/1416] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:17 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1228 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:12:17.784544 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-0347b351-2cc4-49af-b96e-d565235294f3 req-52249fd2-4b9c-4a44-92bb-583f9981cac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ca9033-7531-4f09-83d8-71827ca52adf", "name": "network-vif-plugged", "status": "completed", "tag": "6656dd72-a374-47eb-a01e-f0460c7708eb"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:12:17.794201 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-0347b351-2cc4-49af-b96e-d565235294f3 req-52249fd2-4b9c-4a44-92bb-583f9981cac9 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:17.794784 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-0347b351-2cc4-49af-b96e-d565235294f3 req-52249fd2-4b9c-4a44-92bb-583f9981cac9 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:17.806859 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-0347b351-2cc4-49af-b96e-d565235294f3 req-52249fd2-4b9c-4a44-92bb-583f9981cac9 service nova] Creating event network-vif-plugged:6656dd72-a374-47eb-a01e-f0460c7708eb for instance a1ca9033-7531-4f09-83d8-71827ca52adf on hv-cinder-83607 May 26 17:12:17.811605 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-0347b351-2cc4-49af-b96e-d565235294f3 req-52249fd2-4b9c-4a44-92bb-583f9981cac9 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031200 May 26 17:12:17.812197 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 721/1417] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:18.126282 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-54fe4b3f-6a6c-44a7-aa31-c4545a4b06f8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:18.133800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-54fe4b3f-6a6c-44a7-aa31-c4545a4b06f8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:18.133800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-54fe4b3f-6a6c-44a7-aa31-c4545a4b06f8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:18.133800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-54fe4b3f-6a6c-44a7-aa31-c4545a4b06f8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:18.134585 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-54fe4b3f-6a6c-44a7-aa31-c4545a4b06f8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:18.135022 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-54fe4b3f-6a6c-44a7-aa31-c4545a4b06f8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:18.305732 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-54fe4b3f-6a6c-44a7-aa31-c4545a4b06f8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:18.314066 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-54fe4b3f-6a6c-44a7-aa31-c4545a4b06f8 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.191515 May 26 17:12:18.315538 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 697/1418] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:18 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:12:18.471486 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b36101a1-b7b0-4312-9e04-d884428b54f4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:18.472189 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b36101a1-b7b0-4312-9e04-d884428b54f4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:18.479270 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b36101a1-b7b0-4312-9e04-d884428b54f4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:18.479716 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b36101a1-b7b0-4312-9e04-d884428b54f4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:18.480484 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b36101a1-b7b0-4312-9e04-d884428b54f4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:18.480914 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b36101a1-b7b0-4312-9e04-d884428b54f4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:18.512114 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b36101a1-b7b0-4312-9e04-d884428b54f4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:18.512561 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b36101a1-b7b0-4312-9e04-d884428b54f4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:18.513013 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-b36101a1-b7b0-4312-9e04-d884428b54f4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lazy-loading 'fault' on Instance uuid 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:12:18.557371 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b36101a1-b7b0-4312-9e04-d884428b54f4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:18.564787 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b36101a1-b7b0-4312-9e04-d884428b54f4 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1233 microversion: 2.1 time: 0.097479 May 26 17:12:18.565357 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 722/1419] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:18 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1233 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:19.332232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-88cccaae-65d7-4303-bf54-a1344b607c75 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:19.332846 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-88cccaae-65d7-4303-bf54-a1344b607c75 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:19.340042 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-88cccaae-65d7-4303-bf54-a1344b607c75 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:19.340717 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-88cccaae-65d7-4303-bf54-a1344b607c75 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:19.341491 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-88cccaae-65d7-4303-bf54-a1344b607c75 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:19.341934 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-88cccaae-65d7-4303-bf54-a1344b607c75 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:19.480047 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-88cccaae-65d7-4303-bf54-a1344b607c75 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:19.487438 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-88cccaae-65d7-4303-bf54-a1344b607c75 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.159388 May 26 17:12:19.488004 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 698/1420] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:19 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:19.584317 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9cde4ae2-5138-46c5-be40-6827c525af9f tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:19.585024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9cde4ae2-5138-46c5-be40-6827c525af9f tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:19.592839 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9cde4ae2-5138-46c5-be40-6827c525af9f tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:19.592839 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9cde4ae2-5138-46c5-be40-6827c525af9f tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:19.593225 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9cde4ae2-5138-46c5-be40-6827c525af9f tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:19.593670 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9cde4ae2-5138-46c5-be40-6827c525af9f tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:19.596400 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:19.627370 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9cde4ae2-5138-46c5-be40-6827c525af9f tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:19.627822 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9cde4ae2-5138-46c5-be40-6827c525af9f tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:19.628307 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-9cde4ae2-5138-46c5-be40-6827c525af9f tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lazy-loading 'fault' on Instance uuid 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:12:19.704997 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9cde4ae2-5138-46c5-be40-6827c525af9f tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530b2b1951644755afd1432381cf37f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4f536fcafe46b5ae159b93acb7e041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:19.704997 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9cde4ae2-5138-46c5-be40-6827c525af9f tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 200 len: 1233 microversion: 2.1 time: 0.121972 May 26 17:12:19.704997 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 723/1421] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:19 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 1233 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:20.504899 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0cce9aa7-0bd9-4934-b083-6c4cadd0de3e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:20.505507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0cce9aa7-0bd9-4934-b083-6c4cadd0de3e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:20.513051 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0cce9aa7-0bd9-4934-b083-6c4cadd0de3e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:20.513499 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0cce9aa7-0bd9-4934-b083-6c4cadd0de3e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:20.514346 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0cce9aa7-0bd9-4934-b083-6c4cadd0de3e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:20.514818 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0cce9aa7-0bd9-4934-b083-6c4cadd0de3e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:20.647633 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0cce9aa7-0bd9-4934-b083-6c4cadd0de3e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:20.655704 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0cce9aa7-0bd9-4934-b083-6c4cadd0de3e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.154678 May 26 17:12:20.656234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 699/1422] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:20 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:20.719368 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4415a3c6-c4e3-4222-a9c0-62e6732dc211 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:20.719981 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4415a3c6-c4e3-4222-a9c0-62e6732dc211 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:20.727140 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4415a3c6-c4e3-4222-a9c0-62e6732dc211 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:20.727589 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4415a3c6-c4e3-4222-a9c0-62e6732dc211 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:20.728358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4415a3c6-c4e3-4222-a9c0-62e6732dc211 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:20.728796 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4415a3c6-c4e3-4222-a9c0-62e6732dc211 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:20.742116 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-4415a3c6-c4e3-4222-a9c0-62e6732dc211 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] HTTP exception thrown: Instance 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 could not be found. May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4415a3c6-c4e3-4222-a9c0-62e6732dc211 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Request method failure captured: May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 HTTP/1.1 May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7IWC8FDQR8r2fIIzzAh7BnRmXOYTh4TWSi0hcJ3C6yH5-H8Yla95yIAVFbiY-FAeNYP0fd5p4xGPd5NUxO7uBbvRLPQc5L4nza_JFBSotvduni7sabuzDZLyUBQoPF2f0dju-fOVjTC3xl-k0JMYoRxkKq54rqAN1lLGU5dsBoGc4k May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: ed4f536fcafe46b5ae159b93acb7e041 May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-TestVolumeBootPattern-862722930 May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:12:20.744474 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:12:20.746238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_ed4f536fcafe46b5ae159b93acb7e041"}]}] May 26 17:12:20.746238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-TestVolumeBootPattern-862722930 May 26 17:12:20.746238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: ed4f536fcafe46b5ae159b93acb7e041 May 26 17:12:20.746238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-TestVolumeBootPattern-862722930 May 26 17:12:20.746238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-TestVolumeBootPattern-862722930-project May 26 17:12:20.746238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:12:20.746238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:12:20.746238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 530b2b1951644755afd1432381cf37f9 May 26 17:12:20.746238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-TestVolumeBootPattern-862722930-project May 26 17:12:20.746238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:12:20.746238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 could not be found. May 26 17:12:20.746238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '8949ea8b-a66a-4c3d-a048-3020e3d8b7f9'} May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 could not be found. May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:12:20.747129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 could not be found. May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 could not be found. May 26 17:12:20.748704 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:20.750446 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4415a3c6-c4e3-4222-a9c0-62e6732dc211 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Returning 404 to user: Instance 8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:12:20.750446 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4415a3c6-c4e3-4222-a9c0-62e6732dc211 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9" status: 404 len: 111 microversion: 2.1 time: 0.030405 May 26 17:12:20.750446 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 724/1423] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:20 2022] GET /compute/v2.1/servers/8949ea8b-a66a-4c3d-a048-3020e3d8b7f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:12:21.342885 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2ca63ecf-5343-4d73-9f57-25375b2aebee tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:21.343323 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-2ca63ecf-5343-4d73-9f57-25375b2aebee tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:21.349540 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2ca63ecf-5343-4d73-9f57-25375b2aebee tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:21.350023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2ca63ecf-5343-4d73-9f57-25375b2aebee tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:21.350810 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2ca63ecf-5343-4d73-9f57-25375b2aebee tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:21.351247 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2ca63ecf-5343-4d73-9f57-25375b2aebee tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:21.364680 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-2ca63ecf-5343-4d73-9f57-25375b2aebee tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] HTTP exception thrown: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2ca63ecf-5343-4d73-9f57-25375b2aebee tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Request method failure captured: May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: DELETE /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 HTTP/1.1 May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7IWC8FDQR8r2fIIzzAh7BnRmXOYTh4TWSi0hcJ3C6yH5-H8Yla95yIAVFbiY-FAeNYP0fd5p4xGPd5NUxO7uBbvRLPQc5L4nza_JFBSotvduni7sabuzDZLyUBQoPF2f0dju-fOVjTC3xl-k0JMYoRxkKq54rqAN1lLGU5dsBoGc4k May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: ed4f536fcafe46b5ae159b93acb7e041 May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-TestVolumeBootPattern-862722930 May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:12:21.366341 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:12:21.367961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_ed4f536fcafe46b5ae159b93acb7e041"}]}] May 26 17:12:21.367961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-TestVolumeBootPattern-862722930 May 26 17:12:21.367961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: ed4f536fcafe46b5ae159b93acb7e041 May 26 17:12:21.367961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-TestVolumeBootPattern-862722930 May 26 17:12:21.367961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-TestVolumeBootPattern-862722930-project May 26 17:12:21.367961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:12:21.367961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:12:21.367961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 530b2b1951644755afd1432381cf37f9 May 26 17:12:21.367961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-TestVolumeBootPattern-862722930-project May 26 17:12:21.367961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:12:21.367961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:12:21.367961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': 'cbd9cd4a-70e0-4506-b13a-39216e5b70c2'} May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:12:21.369595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:12:21.371175 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:21.372872 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2ca63ecf-5343-4d73-9f57-25375b2aebee tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Returning 404 to user: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:12:21.372872 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-2ca63ecf-5343-4d73-9f57-25375b2aebee tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "DELETE /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 404 len: 111 microversion: 2.1 time: 0.028830 May 26 17:12:21.372872 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 700/1424] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:12:21 2022] DELETE /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:12:21.376778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bdad7ab8-4be5-4174-b00b-a1d1566f701c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:21.377385 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bdad7ab8-4be5-4174-b00b-a1d1566f701c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] [instance: cbd9cd4a-70e0-4506-b13a-39216e5b70c2] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:21.384069 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bdad7ab8-4be5-4174-b00b-a1d1566f701c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:21.384522 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bdad7ab8-4be5-4174-b00b-a1d1566f701c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:21.385292 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bdad7ab8-4be5-4174-b00b-a1d1566f701c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:21.385728 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bdad7ab8-4be5-4174-b00b-a1d1566f701c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:21.399289 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-bdad7ab8-4be5-4174-b00b-a1d1566f701c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] HTTP exception thrown: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bdad7ab8-4be5-4174-b00b-a1d1566f701c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Request method failure captured: May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 HTTP/1.1 May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7IWC8FDQR8r2fIIzzAh7BnRmXOYTh4TWSi0hcJ3C6yH5-H8Yla95yIAVFbiY-FAeNYP0fd5p4xGPd5NUxO7uBbvRLPQc5L4nza_JFBSotvduni7sabuzDZLyUBQoPF2f0dju-fOVjTC3xl-k0JMYoRxkKq54rqAN1lLGU5dsBoGc4k May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: ed4f536fcafe46b5ae159b93acb7e041 May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-TestVolumeBootPattern-862722930 May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:12:21.400973 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:12:21.402583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/ed4f536fcafe46b5ae159b93acb7e041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_ed4f536fcafe46b5ae159b93acb7e041"}]}] May 26 17:12:21.402583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-TestVolumeBootPattern-862722930 May 26 17:12:21.402583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: ed4f536fcafe46b5ae159b93acb7e041 May 26 17:12:21.402583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-TestVolumeBootPattern-862722930 May 26 17:12:21.402583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-TestVolumeBootPattern-862722930-project May 26 17:12:21.402583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:12:21.402583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:12:21.402583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 530b2b1951644755afd1432381cf37f9 May 26 17:12:21.402583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-TestVolumeBootPattern-862722930-project May 26 17:12:21.402583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:12:21.402583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:12:21.402583 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'cbd9cd4a-70e0-4506-b13a-39216e5b70c2'} May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:12:21.403663 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. May 26 17:12:21.406807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:12:21.408139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bdad7ab8-4be5-4174-b00b-a1d1566f701c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Returning 404 to user: Instance cbd9cd4a-70e0-4506-b13a-39216e5b70c2 could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:12:21.408139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bdad7ab8-4be5-4174-b00b-a1d1566f701c tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2" status: 404 len: 111 microversion: 2.1 time: 0.029446 May 26 17:12:21.408139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 725/1425] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:21 2022] GET /compute/v2.1/servers/cbd9cd4a-70e0-4506-b13a-39216e5b70c2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:12:21.673244 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8e68632a-762a-4359-a0ed-415d0b3cdcb2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:21.673945 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8e68632a-762a-4359-a0ed-415d0b3cdcb2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:21.680709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8e68632a-762a-4359-a0ed-415d0b3cdcb2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:21.681161 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8e68632a-762a-4359-a0ed-415d0b3cdcb2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:21.681931 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8e68632a-762a-4359-a0ed-415d0b3cdcb2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:21.682398 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8e68632a-762a-4359-a0ed-415d0b3cdcb2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:21.815790 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8e68632a-762a-4359-a0ed-415d0b3cdcb2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:21.823260 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8e68632a-762a-4359-a0ed-415d0b3cdcb2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.154499 May 26 17:12:21.823834 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 701/1426] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:21 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:22.841599 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5c3e34f6-699e-4d2b-8f51-4b70186a98a2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:22.842213 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5c3e34f6-699e-4d2b-8f51-4b70186a98a2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:22.849504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c3e34f6-699e-4d2b-8f51-4b70186a98a2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:22.849950 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c3e34f6-699e-4d2b-8f51-4b70186a98a2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:22.850774 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c3e34f6-699e-4d2b-8f51-4b70186a98a2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:22.851262 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5c3e34f6-699e-4d2b-8f51-4b70186a98a2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:22.983861 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5c3e34f6-699e-4d2b-8f51-4b70186a98a2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:22.991339 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5c3e34f6-699e-4d2b-8f51-4b70186a98a2 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.154473 May 26 17:12:22.991899 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 726/1427] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:22 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:24.009859 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-bbdec77a-e007-4584-96e7-531855bb6c32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:24.010496 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-bbdec77a-e007-4584-96e7-531855bb6c32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:24.016940 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bbdec77a-e007-4584-96e7-531855bb6c32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:24.017388 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bbdec77a-e007-4584-96e7-531855bb6c32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:24.018152 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bbdec77a-e007-4584-96e7-531855bb6c32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:24.018618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bbdec77a-e007-4584-96e7-531855bb6c32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:24.021240 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=100 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:24.151777 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bbdec77a-e007-4584-96e7-531855bb6c32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:24.159322 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-bbdec77a-e007-4584-96e7-531855bb6c32 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1318 microversion: 2.1 time: 0.153770 May 26 17:12:24.159881 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 702/1428] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:24 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:25.176141 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b60738f3-1431-466a-b50f-424314703210 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:25.176762 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b60738f3-1431-466a-b50f-424314703210 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:25.184406 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b60738f3-1431-466a-b50f-424314703210 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:25.184858 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b60738f3-1431-466a-b50f-424314703210 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:25.185619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b60738f3-1431-466a-b50f-424314703210 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:25.186054 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b60738f3-1431-466a-b50f-424314703210 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:25.316456 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b60738f3-1431-466a-b50f-424314703210 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:25.325062 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b60738f3-1431-466a-b50f-424314703210 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1503 microversion: 2.1 time: 0.152745 May 26 17:12:25.325627 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 727/1429] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:25 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:26.828945 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-60d061c4-ed9f-4aef-aee8-5c9a7d065d87 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:26.829494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-60d061c4-ed9f-4aef-aee8-5c9a7d065d87 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:26.836215 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-60d061c4-ed9f-4aef-aee8-5c9a7d065d87 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:26.843017 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-60d061c4-ed9f-4aef-aee8-5c9a7d065d87 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:26.843017 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-60d061c4-ed9f-4aef-aee8-5c9a7d065d87 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:26.843017 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-60d061c4-ed9f-4aef-aee8-5c9a7d065d87 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:26.866679 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-60d061c4-ed9f-4aef-aee8-5c9a7d065d87 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Going to try to terminate instance {{(pid=130525) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:12:27.094566 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-31d08e18-acc6-40c2-ab04-2b552d4346ef tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] Calling method '.version_select at 0x7fd25623de50>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:27.144428 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-31d08e18-acc6-40c2-ab04-2b552d4346ef tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/8294f939-6c71-43dc-8129-5f969fd76a1f" status: 200 len: 351 microversion: 2.1 time: 0.054285 May 26 17:12:27.151826 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 728/1430] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:27 2022] GET /compute/v2.1/os-volumes/8294f939-6c71-43dc-8129-5f969fd76a1f => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:27.258651 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e8e6b947-1cad-4c86-b9bf-e52714cb5707 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] Calling method '.version_select at 0x7fd2561f6160>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:27.279377 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-60d061c4-ed9f-4aef-aee8-5c9a7d065d87 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "DELETE /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 204 len: 0 microversion: 2.1 time: 0.454536 May 26 17:12:27.280787 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 703/1431] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:12:26 2022] DELETE /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:12:27.289868 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-121e1efc-66a2-466d-877a-38b616d90767 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:27.290203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-121e1efc-66a2-466d-877a-38b616d90767 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:27.297176 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-121e1efc-66a2-466d-877a-38b616d90767 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:27.297626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-121e1efc-66a2-466d-877a-38b616d90767 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:27.298970 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-121e1efc-66a2-466d-877a-38b616d90767 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:27.299417 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-121e1efc-66a2-466d-877a-38b616d90767 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:27.340951 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e8e6b947-1cad-4c86-b9bf-e52714cb5707 tempest-TestVolumeBootPattern-862722930 tempest-TestVolumeBootPattern-862722930-project] 10.222.0.112 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2141156347" status: 202 len: 0 microversion: 2.1 time: 0.086155 May 26 17:12:27.341797 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 729/1432] 10.222.0.112 () {58 vars in 1267 bytes} [Thu May 26 17:12:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2141156347 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:12:27.449617 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-121e1efc-66a2-466d-877a-38b616d90767 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:27.460032 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-121e1efc-66a2-466d-877a-38b616d90767 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1509 microversion: 2.1 time: 0.174657 May 26 17:12:27.471635 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 704/1433] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:27 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:12:28.478440 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-639bcbbf-085e-4b1c-93c5-6b1946ed3cbc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:28.479666 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-639bcbbf-085e-4b1c-93c5-6b1946ed3cbc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:28.488514 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-639bcbbf-085e-4b1c-93c5-6b1946ed3cbc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:28.488909 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-639bcbbf-085e-4b1c-93c5-6b1946ed3cbc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:28.489683 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-639bcbbf-085e-4b1c-93c5-6b1946ed3cbc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:28.490122 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-639bcbbf-085e-4b1c-93c5-6b1946ed3cbc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:28.982269 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-639bcbbf-085e-4b1c-93c5-6b1946ed3cbc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:28.990505 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-639bcbbf-085e-4b1c-93c5-6b1946ed3cbc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1509 microversion: 2.1 time: 0.516429 May 26 17:12:29.000417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 730/1434] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:28 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1509 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:29.873287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5caf60e4-0006-4873-970b-e77df76553c5 tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] Calling method '.version_select at 0x7fd250ff59d0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:29.937653 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5caf60e4-0006-4873-970b-e77df76553c5 tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/ec45393e-aff5-4c03-8f81-7d54762fe8e4" status: 200 len: 350 microversion: 2.1 time: 0.068659 May 26 17:12:29.938735 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 705/1435] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:29 2022] GET /compute/v2.1/os-volumes/ec45393e-aff5-4c03-8f81-7d54762fe8e4 => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:30.007206 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9c1e61b5-0ea4-4061-9bfc-3cc847e1a318 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:30.008416 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9c1e61b5-0ea4-4061-9bfc-3cc847e1a318 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:30.017718 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9c1e61b5-0ea4-4061-9bfc-3cc847e1a318 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:30.018512 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9c1e61b5-0ea4-4061-9bfc-3cc847e1a318 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:30.019658 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9c1e61b5-0ea4-4061-9bfc-3cc847e1a318 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:30.020088 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9c1e61b5-0ea4-4061-9bfc-3cc847e1a318 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:30.185496 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9c1e61b5-0ea4-4061-9bfc-3cc847e1a318 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:30.193956 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9c1e61b5-0ea4-4061-9bfc-3cc847e1a318 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1509 microversion: 2.1 time: 0.190569 May 26 17:12:30.200966 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 731/1436] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:30 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:30.819504 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-7f4d60e5-4229-4749-9e74-16ea8a2b4ab7 req-fca903e7-393f-4ee4-ba44-c69f363997ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ca9033-7531-4f09-83d8-71827ca52adf", "name": "network-vif-deleted", "tag": "6656dd72-a374-47eb-a01e-f0460c7708eb"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:12:30.833462 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-7f4d60e5-4229-4749-9e74-16ea8a2b4ab7 req-fca903e7-393f-4ee4-ba44-c69f363997ed service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:30.835696 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-7f4d60e5-4229-4749-9e74-16ea8a2b4ab7 req-fca903e7-393f-4ee4-ba44-c69f363997ed service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:30.860243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-7f4d60e5-4229-4749-9e74-16ea8a2b4ab7 req-fca903e7-393f-4ee4-ba44-c69f363997ed service nova] Creating event network-vif-deleted:6656dd72-a374-47eb-a01e-f0460c7708eb for instance a1ca9033-7531-4f09-83d8-71827ca52adf on hv-cinder-83607 May 26 17:12:30.867404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-7f4d60e5-4229-4749-9e74-16ea8a2b4ab7 req-fca903e7-393f-4ee4-ba44-c69f363997ed service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050694 May 26 17:12:30.869582 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 706/1437] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:31.219918 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-1c4b7ac7-447f-4a16-b5cc-0ab47a7cd32e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:31.220568 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-1c4b7ac7-447f-4a16-b5cc-0ab47a7cd32e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:31.228160 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1c4b7ac7-447f-4a16-b5cc-0ab47a7cd32e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:31.228800 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1c4b7ac7-447f-4a16-b5cc-0ab47a7cd32e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:31.229581 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1c4b7ac7-447f-4a16-b5cc-0ab47a7cd32e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:31.231077 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-1c4b7ac7-447f-4a16-b5cc-0ab47a7cd32e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:31.312065 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-1c4b7ac7-447f-4a16-b5cc-0ab47a7cd32e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:31.320885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-1c4b7ac7-447f-4a16-b5cc-0ab47a7cd32e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 200 len: 1303 microversion: 2.1 time: 0.104809 May 26 17:12:31.321577 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 732/1438] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:31 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:32.341738 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-89277c07-ee51-4899-95b7-654426de561e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:32.342456 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-89277c07-ee51-4899-95b7-654426de561e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: a1ca9033-7531-4f09-83d8-71827ca52adf] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:32.349235 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-89277c07-ee51-4899-95b7-654426de561e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:32.349776 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-89277c07-ee51-4899-95b7-654426de561e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:32.350748 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-89277c07-ee51-4899-95b7-654426de561e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:32.351426 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-89277c07-ee51-4899-95b7-654426de561e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:32.366960 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-89277c07-ee51-4899-95b7-654426de561e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] HTTP exception thrown: Instance a1ca9033-7531-4f09-83d8-71827ca52adf could not be found. May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-89277c07-ee51-4899-95b7-654426de561e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Request method failure captured: May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf HTTP/1.1 May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7Tb1INILk4oL4x73UzGqeJgbOcMRUz_Ly1zQELpNA9c7YxNPNV2FfCcBvHWKx-_v9zSQn0J77Hr3i7qYo17fPux5fpah6y1hyxQsX1mRISVi14buFAxC4vT_KScxR2gglRvboaHL5DeX0aYAUf5i4onB9EHoKQykII8lEE1mMjDjsQ May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 3511d2b2c4014889ae449a05344ff57d May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-VolumesActionsTest-1979607197 May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:12:32.368620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:12:32.370172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/3511d2b2c4014889ae449a05344ff57d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/3511d2b2c4014889ae449a05344ff57d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/3511d2b2c4014889ae449a05344ff57d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_3511d2b2c4014889ae449a05344ff57d"}]}] May 26 17:12:32.370172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-VolumesActionsTest-1979607197 May 26 17:12:32.370172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 3511d2b2c4014889ae449a05344ff57d May 26 17:12:32.370172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-VolumesActionsTest-1979607197 May 26 17:12:32.370172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-VolumesActionsTest-1979607197-project May 26 17:12:32.370172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:12:32.370172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:12:32.370172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 21c11bd00fde4b6a914ce707a502784a May 26 17:12:32.370172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-VolumesActionsTest-1979607197-project May 26 17:12:32.370172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:12:32.370172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance a1ca9033-7531-4f09-83d8-71827ca52adf could not be found. May 26 17:12:32.370172 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': 'a1ca9033-7531-4f09-83d8-71827ca52adf'} May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ca9033-7531-4f09-83d8-71827ca52adf could not be found. May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:12:32.374920 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ca9033-7531-4f09-83d8-71827ca52adf could not be found. May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ca9033-7531-4f09-83d8-71827ca52adf could not be found. May 26 17:12:32.376415 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:12:32.377842 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-89277c07-ee51-4899-95b7-654426de561e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Returning 404 to user: Instance a1ca9033-7531-4f09-83d8-71827ca52adf could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:12:32.377842 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-89277c07-ee51-4899-95b7-654426de561e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf" status: 404 len: 111 microversion: 2.1 time: 0.033064 May 26 17:12:32.377842 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 707/1439] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:32 2022] GET /compute/v2.1/servers/a1ca9033-7531-4f09-83d8-71827ca52adf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:12:32.477592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1376002132", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "networks": [{"uuid": "7284e265-d11f-4bc2-b6f6-f0a16830bd27"}]}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:12:32.531721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.network.neutron [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] validate_networks() for [('7284e265-d11f-4bc2-b6f6-f0a16830bd27', None, None, None, None, None)] {{(pid=130526) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:12:32.828627 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-95563d9f-79df-4baf-af9b-e8e7de1df5e2 tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] Calling method '.version_select at 0x7fd251042310>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:32.887079 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-95563d9f-79df-4baf-af9b-e8e7de1df5e2 tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/17e2eedb-4973-4207-85b9-a08d9b58cdb7" status: 200 len: 351 microversion: 2.1 time: 0.067620 May 26 17:12:32.888928 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 708/1440] 10.222.0.112 () {58 vars in 1249 bytes} [Thu May 26 17:12:32 2022] GET /compute/v2.1/os-volumes/17e2eedb-4973-4207-85b9-a08d9b58cdb7 => generated 351 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:12:32.901156 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-1928263f-7cfa-4cb5-bbe2-65fe6c96af8d tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] Calling method '.version_select at 0x7fd25624bf70>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:32.993614 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-1928263f-7cfa-4cb5-bbe2-65fe6c96af8d tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] 10.222.0.112 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096900 May 26 17:12:32.994704 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 709/1441] 10.222.0.112 () {58 vars in 1138 bytes} [Thu May 26 17:12:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:12:33.013299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0f875aa2-5cea-470c-acc3-c91300180882 tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] Calling method '.version_select at 0x7fd250ff5820>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:33.051785 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Flavor limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:12:33.052284 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Image limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:12:33.052985 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Flavor pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:12:33.053736 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Image pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:12:33.054217 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:12:33.064799 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:33.068806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:33.068806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:33.068806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:33.084033 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Getting quotas for project 3511d2b2c4014889ae449a05344ff57d. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:12:33.088096 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Getting quotas for user 21c11bd00fde4b6a914ce707a502784a and project 3511d2b2c4014889ae449a05344ff57d. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:12:33.100006 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Going to run 1 instances... {{(pid=130526) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:12:33.102206 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:12:33.103830 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0f875aa2-5cea-470c-acc3-c91300180882 tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] 10.222.0.112 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095564 May 26 17:12:33.104402 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 710/1442] 10.222.0.112 () {58 vars in 1153 bytes} [Thu May 26 17:12:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:12:33.122425 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ca7b034e-7976-4060-bf52-48828c0e9388 tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] Calling method '.version_select at 0x7fd25624b040>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:33.200158 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ca7b034e-7976-4060-bf52-48828c0e9388 tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] 10.222.0.112 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086513 May 26 17:12:33.200844 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 711/1443] 10.222.0.112 () {58 vars in 1138 bytes} [Thu May 26 17:12:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:12:33.211990 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f62c9a47-7412-4678-aeab-624ac42cbcfc tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] Calling method '.version_select at 0x7fd251209310>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:33.299477 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f62c9a47-7412-4678-aeab-624ac42cbcfc tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] 10.222.0.112 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091079 May 26 17:12:33.300125 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 712/1444] 10.222.0.112 () {58 vars in 1171 bytes} [Thu May 26 17:12:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:12:33.325886 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-53057a6e-23e5-42b0-ad37-5dccc9df28a6 tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] Calling method '.version_select at 0x7fd256221430>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:33.416897 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-2908d6fd-04ba-40c4-87fd-e29b1b8ecc70 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.943067 May 26 17:12:33.421256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 733/1445] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:12:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 17:12:33.431830 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-16f12c4d-a795-4db1-9c8d-4e7a4b9b4cfb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:33.432242 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-53057a6e-23e5-42b0-ad37-5dccc9df28a6 tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.110239 May 26 17:12:33.433924 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-16f12c4d-a795-4db1-9c8d-4e7a4b9b4cfb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:33.436161 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 713/1446] 10.222.0.112 () {58 vars in 1174 bytes} [Thu May 26 17:12:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:12:33.448717 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-244a6cd6-b11a-4d1c-994f-9d247cf5c92e tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] Calling method '.version_select at 0x7fd250ff59d0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:33.543600 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-16f12c4d-a795-4db1-9c8d-4e7a4b9b4cfb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:33.582249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-244a6cd6-b11a-4d1c-994f-9d247cf5c92e tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.133795 May 26 17:12:33.582249 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 714/1447] 10.222.0.112 () {58 vars in 1159 bytes} [Thu May 26 17:12:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:12:33.591828 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3c6fbb8d-ca7a-4c05-9c93-1cc82ebb8461 tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] Calling method '.version_select at 0x7fd251042dc0>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:33.598251 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-16f12c4d-a795-4db1-9c8d-4e7a4b9b4cfb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1218 microversion: 2.1 time: 0.170741 May 26 17:12:33.611324 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 734/1448] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:33 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:12:33.690683 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3c6fbb8d-ca7a-4c05-9c93-1cc82ebb8461 tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.103439 May 26 17:12:33.691677 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 715/1449] 10.222.0.112 () {58 vars in 1192 bytes} [Thu May 26 17:12:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:12:33.704287 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d76ecb40-dc12-4439-95e0-062d90c6bdda tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] Calling method '.version_select at 0x7fd250db79d0>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:33.792056 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d76ecb40-dc12-4439-95e0-062d90c6bdda tempest-VolumesTestJSON-1719457162 tempest-VolumesTestJSON-1719457162-project] 10.222.0.112 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091913 May 26 17:12:33.792916 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 735/1450] 10.222.0.112 () {58 vars in 1159 bytes} [Thu May 26 17:12:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:34.617510 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fe6aa185-e40f-43e5-906b-23a6251a1366 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:34.618925 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fe6aa185-e40f-43e5-906b-23a6251a1366 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:34.625284 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe6aa185-e40f-43e5-906b-23a6251a1366 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:34.625725 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe6aa185-e40f-43e5-906b-23a6251a1366 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:34.626519 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe6aa185-e40f-43e5-906b-23a6251a1366 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:34.627139 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fe6aa185-e40f-43e5-906b-23a6251a1366 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:34.688587 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fe6aa185-e40f-43e5-906b-23a6251a1366 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:34.696714 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fe6aa185-e40f-43e5-906b-23a6251a1366 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1222 microversion: 2.1 time: 0.083633 May 26 17:12:34.697448 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 716/1451] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:34 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:35.721076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c236f613-0cd4-4295-bb32-8fb353f2d0d7 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:35.723850 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c236f613-0cd4-4295-bb32-8fb353f2d0d7 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:35.738778 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c236f613-0cd4-4295-bb32-8fb353f2d0d7 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:35.740029 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c236f613-0cd4-4295-bb32-8fb353f2d0d7 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:35.742803 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c236f613-0cd4-4295-bb32-8fb353f2d0d7 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:35.744040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c236f613-0cd4-4295-bb32-8fb353f2d0d7 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:35.867467 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c236f613-0cd4-4295-bb32-8fb353f2d0d7 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:35.877229 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c236f613-0cd4-4295-bb32-8fb353f2d0d7 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1270 microversion: 2.1 time: 0.164673 May 26 17:12:35.880275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 736/1452] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:35 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:36.900400 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4e17ee7b-ba35-4e4b-a042-c2bf6a0bdb5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:36.900400 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4e17ee7b-ba35-4e4b-a042-c2bf6a0bdb5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:36.914510 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:36.921935 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e17ee7b-ba35-4e4b-a042-c2bf6a0bdb5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:36.924280 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e17ee7b-ba35-4e4b-a042-c2bf6a0bdb5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:36.928797 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e17ee7b-ba35-4e4b-a042-c2bf6a0bdb5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:36.928797 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4e17ee7b-ba35-4e4b-a042-c2bf6a0bdb5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:37.048683 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4e17ee7b-ba35-4e4b-a042-c2bf6a0bdb5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:37.056511 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4e17ee7b-ba35-4e4b-a042-c2bf6a0bdb5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1288 microversion: 2.1 time: 0.162875 May 26 17:12:37.056781 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 717/1453] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:36 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1288 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:38.072851 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-202be21d-d84e-4ecf-bd1a-0f50a3dad8d1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:38.073454 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-202be21d-d84e-4ecf-bd1a-0f50a3dad8d1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:38.076389 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:38.081036 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-202be21d-d84e-4ecf-bd1a-0f50a3dad8d1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:38.081786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-202be21d-d84e-4ecf-bd1a-0f50a3dad8d1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:38.082568 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-202be21d-d84e-4ecf-bd1a-0f50a3dad8d1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:38.082996 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-202be21d-d84e-4ecf-bd1a-0f50a3dad8d1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:38.237739 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-202be21d-d84e-4ecf-bd1a-0f50a3dad8d1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:38.245402 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-202be21d-d84e-4ecf-bd1a-0f50a3dad8d1 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.176344 May 26 17:12:38.246018 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 737/1454] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:38 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:38.576243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-a86638dc-3f04-4c80-a002-05f42605aad6 req-685c6a76-cd3c-45e5-b403-a8bdb6071fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6530a9f7-ce70-4a6d-bf14-aeb2155d1931", "tag": "4398bddb-f8fa-4428-899e-74af820cfc35"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:12:38.588448 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-a86638dc-3f04-4c80-a002-05f42605aad6 req-685c6a76-cd3c-45e5-b403-a8bdb6071fde service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:38.591457 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-a86638dc-3f04-4c80-a002-05f42605aad6 req-685c6a76-cd3c-45e5-b403-a8bdb6071fde service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:38.610082 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-a86638dc-3f04-4c80-a002-05f42605aad6 req-685c6a76-cd3c-45e5-b403-a8bdb6071fde service nova] Creating event network-changed:4398bddb-f8fa-4428-899e-74af820cfc35 for instance 6530a9f7-ce70-4a6d-bf14-aeb2155d1931 on hv-cinder-83607 May 26 17:12:38.615557 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-a86638dc-3f04-4c80-a002-05f42605aad6 req-685c6a76-cd3c-45e5-b403-a8bdb6071fde service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044407 May 26 17:12:38.616603 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 718/1455] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:12:39.269705 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-5b2f24c8-d7b0-47f5-8f63-1c1dc664521d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:39.286855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-5b2f24c8-d7b0-47f5-8f63-1c1dc664521d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:39.307730 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b2f24c8-d7b0-47f5-8f63-1c1dc664521d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:39.309269 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b2f24c8-d7b0-47f5-8f63-1c1dc664521d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:39.310842 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b2f24c8-d7b0-47f5-8f63-1c1dc664521d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:39.311685 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-5b2f24c8-d7b0-47f5-8f63-1c1dc664521d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:39.590990 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-5b2f24c8-d7b0-47f5-8f63-1c1dc664521d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:39.599178 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-5b2f24c8-d7b0-47f5-8f63-1c1dc664521d tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.340194 May 26 17:12:39.600045 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 738/1456] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:39 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:40.618345 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ef0f705b-b2f5-41dc-9634-d17ce07c77f6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:40.619404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ef0f705b-b2f5-41dc-9634-d17ce07c77f6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:40.626907 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ef0f705b-b2f5-41dc-9634-d17ce07c77f6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:40.629527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ef0f705b-b2f5-41dc-9634-d17ce07c77f6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:40.629527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ef0f705b-b2f5-41dc-9634-d17ce07c77f6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:40.629527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ef0f705b-b2f5-41dc-9634-d17ce07c77f6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:40.779565 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ef0f705b-b2f5-41dc-9634-d17ce07c77f6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:40.782965 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ef0f705b-b2f5-41dc-9634-d17ce07c77f6 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.169560 May 26 17:12:40.783549 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 719/1457] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:40 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:41.799898 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c9d90fa0-5de5-4af8-9b2c-3ed4cc05a59c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:41.800497 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c9d90fa0-5de5-4af8-9b2c-3ed4cc05a59c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:41.807248 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c9d90fa0-5de5-4af8-9b2c-3ed4cc05a59c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:41.807756 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c9d90fa0-5de5-4af8-9b2c-3ed4cc05a59c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:41.809156 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c9d90fa0-5de5-4af8-9b2c-3ed4cc05a59c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:41.809589 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c9d90fa0-5de5-4af8-9b2c-3ed4cc05a59c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:41.946345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c9d90fa0-5de5-4af8-9b2c-3ed4cc05a59c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:41.954238 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c9d90fa0-5de5-4af8-9b2c-3ed4cc05a59c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.158581 May 26 17:12:41.954867 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 739/1458] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:41 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:42.971896 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-91fa0c6c-46dc-4d84-8d9b-e138a7266c0a tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:42.972749 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-91fa0c6c-46dc-4d84-8d9b-e138a7266c0a tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:42.981604 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91fa0c6c-46dc-4d84-8d9b-e138a7266c0a tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:42.982197 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91fa0c6c-46dc-4d84-8d9b-e138a7266c0a tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:42.983137 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91fa0c6c-46dc-4d84-8d9b-e138a7266c0a tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:42.983654 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-91fa0c6c-46dc-4d84-8d9b-e138a7266c0a tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:43.192790 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-91fa0c6c-46dc-4d84-8d9b-e138a7266c0a tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:43.201091 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-91fa0c6c-46dc-4d84-8d9b-e138a7266c0a tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.232954 May 26 17:12:43.211758 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 720/1459] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:42 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:44.218560 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f9a75936-ed3d-4dbc-b21d-fe19dbbf785f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:44.219177 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f9a75936-ed3d-4dbc-b21d-fe19dbbf785f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:44.221472 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:44.222164 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=8 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:44.227180 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f9a75936-ed3d-4dbc-b21d-fe19dbbf785f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:44.227626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f9a75936-ed3d-4dbc-b21d-fe19dbbf785f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:44.228399 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f9a75936-ed3d-4dbc-b21d-fe19dbbf785f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:44.228837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f9a75936-ed3d-4dbc-b21d-fe19dbbf785f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:44.357159 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-f9a75936-ed3d-4dbc-b21d-fe19dbbf785f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:44.364593 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f9a75936-ed3d-4dbc-b21d-fe19dbbf785f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.150360 May 26 17:12:44.365166 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 740/1460] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:44 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:45.382217 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-372d4839-2a60-46b6-b6e7-3a4ec0ef1b63 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:45.382890 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-372d4839-2a60-46b6-b6e7-3a4ec0ef1b63 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:45.390110 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-372d4839-2a60-46b6-b6e7-3a4ec0ef1b63 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:45.390593 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-372d4839-2a60-46b6-b6e7-3a4ec0ef1b63 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:45.391356 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-372d4839-2a60-46b6-b6e7-3a4ec0ef1b63 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:45.391823 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-372d4839-2a60-46b6-b6e7-3a4ec0ef1b63 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:45.521196 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-372d4839-2a60-46b6-b6e7-3a4ec0ef1b63 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:45.528588 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-372d4839-2a60-46b6-b6e7-3a4ec0ef1b63 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.150227 May 26 17:12:45.529153 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 721/1461] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:45 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:46.546075 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d0d85a6e-27bc-4fad-9e62-d56458371ced tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:46.546647 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d0d85a6e-27bc-4fad-9e62-d56458371ced tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:46.553749 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d0d85a6e-27bc-4fad-9e62-d56458371ced tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:46.554194 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d0d85a6e-27bc-4fad-9e62-d56458371ced tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:46.554998 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d0d85a6e-27bc-4fad-9e62-d56458371ced tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:46.555436 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d0d85a6e-27bc-4fad-9e62-d56458371ced tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:46.686983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d0d85a6e-27bc-4fad-9e62-d56458371ced tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:46.694303 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d0d85a6e-27bc-4fad-9e62-d56458371ced tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.153207 May 26 17:12:46.694929 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 741/1462] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:46 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:12:47.711377 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-da08448e-2392-4cf8-8412-5d51dc4836ac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:47.711995 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-da08448e-2392-4cf8-8412-5d51dc4836ac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:47.719317 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-da08448e-2392-4cf8-8412-5d51dc4836ac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:47.719771 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-da08448e-2392-4cf8-8412-5d51dc4836ac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:47.720541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-da08448e-2392-4cf8-8412-5d51dc4836ac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:47.720976 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-da08448e-2392-4cf8-8412-5d51dc4836ac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:47.851751 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-da08448e-2392-4cf8-8412-5d51dc4836ac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:47.859935 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-da08448e-2392-4cf8-8412-5d51dc4836ac tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.152372 May 26 17:12:47.860514 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 722/1463] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:47 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:48.651213 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-d4c99da6-571a-42c3-ac98-330527e79485 req-4441b70f-4c9b-4192-af20-afa6be2b8163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6530a9f7-ce70-4a6d-bf14-aeb2155d1931", "name": "network-vif-plugged", "status": "completed", "tag": "4398bddb-f8fa-4428-899e-74af820cfc35"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:12:48.660132 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-d4c99da6-571a-42c3-ac98-330527e79485 req-4441b70f-4c9b-4192-af20-afa6be2b8163 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:48.660857 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-d4c99da6-571a-42c3-ac98-330527e79485 req-4441b70f-4c9b-4192-af20-afa6be2b8163 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:48.672497 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-d4c99da6-571a-42c3-ac98-330527e79485 req-4441b70f-4c9b-4192-af20-afa6be2b8163 service nova] Creating event network-vif-plugged:4398bddb-f8fa-4428-899e-74af820cfc35 for instance 6530a9f7-ce70-4a6d-bf14-aeb2155d1931 on hv-cinder-83607 May 26 17:12:48.677483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-d4c99da6-571a-42c3-ac98-330527e79485 req-4441b70f-4c9b-4192-af20-afa6be2b8163 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029896 May 26 17:12:48.678060 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 742/1464] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:12:48.877115 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b562a2c4-570c-4c1c-a83e-6ca7bed76b5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:48.877728 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b562a2c4-570c-4c1c-a83e-6ca7bed76b5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:48.884181 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b562a2c4-570c-4c1c-a83e-6ca7bed76b5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:48.884621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b562a2c4-570c-4c1c-a83e-6ca7bed76b5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:48.885387 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b562a2c4-570c-4c1c-a83e-6ca7bed76b5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:48.885821 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b562a2c4-570c-4c1c-a83e-6ca7bed76b5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:49.030800 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b562a2c4-570c-4c1c-a83e-6ca7bed76b5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:49.038209 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b562a2c4-570c-4c1c-a83e-6ca7bed76b5f tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.165092 May 26 17:12:49.038810 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 723/1465] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:48 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:50.061739 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-d25c7c3d-4fe2-4e3b-81b1-a8e0e94ce2dc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:50.061739 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-d25c7c3d-4fe2-4e3b-81b1-a8e0e94ce2dc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:50.067070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d25c7c3d-4fe2-4e3b-81b1-a8e0e94ce2dc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:50.067070 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d25c7c3d-4fe2-4e3b-81b1-a8e0e94ce2dc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:50.067312 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d25c7c3d-4fe2-4e3b-81b1-a8e0e94ce2dc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:50.067747 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-d25c7c3d-4fe2-4e3b-81b1-a8e0e94ce2dc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:50.201012 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-d25c7c3d-4fe2-4e3b-81b1-a8e0e94ce2dc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:50.209036 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-d25c7c3d-4fe2-4e3b-81b1-a8e0e94ce2dc tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.156660 May 26 17:12:50.209614 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 743/1466] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:50 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:51.226545 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f14c64d5-8213-4aea-8502-d4b347c8071e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:51.227164 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f14c64d5-8213-4aea-8502-d4b347c8071e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:51.233750 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f14c64d5-8213-4aea-8502-d4b347c8071e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:51.234201 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f14c64d5-8213-4aea-8502-d4b347c8071e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:51.234995 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f14c64d5-8213-4aea-8502-d4b347c8071e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:51.235458 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f14c64d5-8213-4aea-8502-d4b347c8071e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:51.365135 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f14c64d5-8213-4aea-8502-d4b347c8071e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:51.373150 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f14c64d5-8213-4aea-8502-d4b347c8071e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.150531 May 26 17:12:51.373722 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 724/1467] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:51 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:52.391136 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e438e6a2-e5e6-4c48-ba0a-4bc1b0486dc3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:52.391727 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e438e6a2-e5e6-4c48-ba0a-4bc1b0486dc3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:52.397903 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e438e6a2-e5e6-4c48-ba0a-4bc1b0486dc3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:52.398368 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e438e6a2-e5e6-4c48-ba0a-4bc1b0486dc3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:52.399124 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e438e6a2-e5e6-4c48-ba0a-4bc1b0486dc3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:52.399554 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e438e6a2-e5e6-4c48-ba0a-4bc1b0486dc3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:52.532308 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e438e6a2-e5e6-4c48-ba0a-4bc1b0486dc3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:52.539949 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e438e6a2-e5e6-4c48-ba0a-4bc1b0486dc3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.153876 May 26 17:12:52.544684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 744/1468] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:52 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:53.557045 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-aa51637d-55dd-4f03-8e52-c20662364164 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:53.557659 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-aa51637d-55dd-4f03-8e52-c20662364164 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:53.564799 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aa51637d-55dd-4f03-8e52-c20662364164 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:53.565248 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aa51637d-55dd-4f03-8e52-c20662364164 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:53.566025 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aa51637d-55dd-4f03-8e52-c20662364164 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:53.566494 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-aa51637d-55dd-4f03-8e52-c20662364164 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:53.866663 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-aa51637d-55dd-4f03-8e52-c20662364164 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:53.874192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-aa51637d-55dd-4f03-8e52-c20662364164 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.320975 May 26 17:12:53.874830 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 725/1469] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:53 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:54.891587 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-8a7f38f4-c7bb-4de3-9cae-d1939915076e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:54.899719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-8a7f38f4-c7bb-4de3-9cae-d1939915076e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:54.899719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8a7f38f4-c7bb-4de3-9cae-d1939915076e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:54.899719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8a7f38f4-c7bb-4de3-9cae-d1939915076e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:54.899719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8a7f38f4-c7bb-4de3-9cae-d1939915076e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:54.900234 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-8a7f38f4-c7bb-4de3-9cae-d1939915076e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:54.902855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=94 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:55.030485 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-8a7f38f4-c7bb-4de3-9cae-d1939915076e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:55.039023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-8a7f38f4-c7bb-4de3-9cae-d1939915076e tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1318 microversion: 2.1 time: 0.151800 May 26 17:12:55.039894 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 745/1470] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:54 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:56.056054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-db9fd2b6-9444-4b23-a929-e7bcf0426c72 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:56.056676 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-db9fd2b6-9444-4b23-a929-e7bcf0426c72 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:56.063815 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-db9fd2b6-9444-4b23-a929-e7bcf0426c72 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:56.064258 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-db9fd2b6-9444-4b23-a929-e7bcf0426c72 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:56.065023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-db9fd2b6-9444-4b23-a929-e7bcf0426c72 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:56.065453 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-db9fd2b6-9444-4b23-a929-e7bcf0426c72 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:56.068105 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:56.197456 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-db9fd2b6-9444-4b23-a929-e7bcf0426c72 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:56.205006 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-db9fd2b6-9444-4b23-a929-e7bcf0426c72 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1502 microversion: 2.1 time: 0.152753 May 26 17:12:56.205568 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 726/1471] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:56 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:57.579785 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c7218a54-d710-4337-8b67-8a82b2e3c563 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:57.580337 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c7218a54-d710-4337-8b67-8a82b2e3c563 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:57.587084 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c7218a54-d710-4337-8b67-8a82b2e3c563 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:57.587532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c7218a54-d710-4337-8b67-8a82b2e3c563 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:57.588292 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c7218a54-d710-4337-8b67-8a82b2e3c563 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:57.588729 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c7218a54-d710-4337-8b67-8a82b2e3c563 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:57.614614 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c7218a54-d710-4337-8b67-8a82b2e3c563 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Going to try to terminate instance {{(pid=130526) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:12:58.004792 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c7218a54-d710-4337-8b67-8a82b2e3c563 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "DELETE /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 204 len: 0 microversion: 2.1 time: 0.429133 May 26 17:12:58.005422 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 746/1472] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:12:57 2022] DELETE /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:12:58.013484 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0da46b1c-40ab-44e0-8b38-af7eceaf0674 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:58.014093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0da46b1c-40ab-44e0-8b38-af7eceaf0674 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:58.021636 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0da46b1c-40ab-44e0-8b38-af7eceaf0674 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:58.022023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0da46b1c-40ab-44e0-8b38-af7eceaf0674 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:58.022842 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0da46b1c-40ab-44e0-8b38-af7eceaf0674 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:58.023281 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0da46b1c-40ab-44e0-8b38-af7eceaf0674 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:58.157499 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0da46b1c-40ab-44e0-8b38-af7eceaf0674 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:58.165100 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0da46b1c-40ab-44e0-8b38-af7eceaf0674 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1508 microversion: 2.1 time: 0.155419 May 26 17:12:58.165664 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 727/1473] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:58 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:12:59.183397 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dd8c6d63-a73d-4b5a-a02c-b67f94d413c3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:12:59.184026 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-dd8c6d63-a73d-4b5a-a02c-b67f94d413c3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:12:59.190715 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dd8c6d63-a73d-4b5a-a02c-b67f94d413c3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:59.191164 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dd8c6d63-a73d-4b5a-a02c-b67f94d413c3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:59.191926 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dd8c6d63-a73d-4b5a-a02c-b67f94d413c3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:12:59.192366 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dd8c6d63-a73d-4b5a-a02c-b67f94d413c3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:12:59.395940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dd8c6d63-a73d-4b5a-a02c-b67f94d413c3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:12:59.403561 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-dd8c6d63-a73d-4b5a-a02c-b67f94d413c3 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1508 microversion: 2.1 time: 0.224495 May 26 17:12:59.404138 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 747/1474] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:12:59 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:00.421126 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8379fc63-54ec-4567-99fb-2384667249f9 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:00.421795 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8379fc63-54ec-4567-99fb-2384667249f9 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:00.428257 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8379fc63-54ec-4567-99fb-2384667249f9 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:00.428703 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8379fc63-54ec-4567-99fb-2384667249f9 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:00.429464 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8379fc63-54ec-4567-99fb-2384667249f9 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:00.429895 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8379fc63-54ec-4567-99fb-2384667249f9 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:00.568383 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8379fc63-54ec-4567-99fb-2384667249f9 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:00.581012 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8379fc63-54ec-4567-99fb-2384667249f9 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1508 microversion: 2.1 time: 0.162954 May 26 17:13:00.581619 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 728/1475] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:00 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:01.601189 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-e94896df-2380-45d3-af56-ab49e9720617 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:01.601867 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-e94896df-2380-45d3-af56-ab49e9720617 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:01.611511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e94896df-2380-45d3-af56-ab49e9720617 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:01.611934 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e94896df-2380-45d3-af56-ab49e9720617 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:01.613047 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e94896df-2380-45d3-af56-ab49e9720617 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:01.613525 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-e94896df-2380-45d3-af56-ab49e9720617 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:01.751325 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-e94896df-2380-45d3-af56-ab49e9720617 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:01.759249 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-e94896df-2380-45d3-af56-ab49e9720617 tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1508 microversion: 2.1 time: 0.162879 May 26 17:13:01.760149 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 748/1476] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:01 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:01.821123 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-bda277d5-578a-47b3-86b9-3c1cd140ff25 req-529ba949-5303-4970-9d7c-b80b7643330c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6530a9f7-ce70-4a6d-bf14-aeb2155d1931", "name": "network-vif-deleted", "tag": "4398bddb-f8fa-4428-899e-74af820cfc35"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:13:01.830316 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-bda277d5-578a-47b3-86b9-3c1cd140ff25 req-529ba949-5303-4970-9d7c-b80b7643330c service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:01.830782 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-bda277d5-578a-47b3-86b9-3c1cd140ff25 req-529ba949-5303-4970-9d7c-b80b7643330c service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:01.848000 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-bda277d5-578a-47b3-86b9-3c1cd140ff25 req-529ba949-5303-4970-9d7c-b80b7643330c service nova] Creating event network-vif-deleted:4398bddb-f8fa-4428-899e-74af820cfc35 for instance 6530a9f7-ce70-4a6d-bf14-aeb2155d1931 on hv-cinder-83607 May 26 17:13:01.854232 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-bda277d5-578a-47b3-86b9-3c1cd140ff25 req-529ba949-5303-4970-9d7c-b80b7643330c service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037027 May 26 17:13:01.854788 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 729/1477] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:13:02.781472 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-387f6c43-902d-48d0-b82a-4bfcde7f37bb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:02.782298 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-387f6c43-902d-48d0-b82a-4bfcde7f37bb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:02.789885 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-387f6c43-902d-48d0-b82a-4bfcde7f37bb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:02.790439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-387f6c43-902d-48d0-b82a-4bfcde7f37bb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:02.791325 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-387f6c43-902d-48d0-b82a-4bfcde7f37bb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:02.791834 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-387f6c43-902d-48d0-b82a-4bfcde7f37bb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:02.827565 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-387f6c43-902d-48d0-b82a-4bfcde7f37bb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:02.828055 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-387f6c43-902d-48d0-b82a-4bfcde7f37bb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:02.828456 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-387f6c43-902d-48d0-b82a-4bfcde7f37bb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lazy-loading 'fault' on Instance uuid 6530a9f7-ce70-4a6d-bf14-aeb2155d1931 {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:13:02.874076 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-387f6c43-902d-48d0-b82a-4bfcde7f37bb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c11bd00fde4b6a914ce707a502784a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511d2b2c4014889ae449a05344ff57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:02.880220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-387f6c43-902d-48d0-b82a-4bfcde7f37bb tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 200 len: 1308 microversion: 2.1 time: 0.105862 May 26 17:13:02.889908 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 749/1478] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:02 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:03.897731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5b42e5da-0e04-4bb0-98dc-7fa4aa54871c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:03.898749 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-5b42e5da-0e04-4bb0-98dc-7fa4aa54871c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] [instance: 6530a9f7-ce70-4a6d-bf14-aeb2155d1931] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:03.906412 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5b42e5da-0e04-4bb0-98dc-7fa4aa54871c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:03.906894 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5b42e5da-0e04-4bb0-98dc-7fa4aa54871c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:03.907836 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5b42e5da-0e04-4bb0-98dc-7fa4aa54871c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:03.908277 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-5b42e5da-0e04-4bb0-98dc-7fa4aa54871c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:03.922546 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-5b42e5da-0e04-4bb0-98dc-7fa4aa54871c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] HTTP exception thrown: Instance 6530a9f7-ce70-4a6d-bf14-aeb2155d1931 could not be found. May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5b42e5da-0e04-4bb0-98dc-7fa4aa54871c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Request method failure captured: May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 HTTP/1.1 May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7Tb1INILk4oL4x73UzGqeJgbOcMRUz_Ly1zQELpNA9c7YxNPNV2FfCcBvHWKx-_v9zSQn0J77Hr3i7qYo17fPux5fpah6y1hyxQsX1mRISVi14buFAxC4vT_KScxR2gglRvboaHL5DeX0aYAUf5i4onB9EHoKQykII8lEE1mMjDjsQ May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: 3511d2b2c4014889ae449a05344ff57d May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-VolumesActionsTest-1979607197 May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:13:03.924299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:13:03.926041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/3511d2b2c4014889ae449a05344ff57d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/3511d2b2c4014889ae449a05344ff57d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/3511d2b2c4014889ae449a05344ff57d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_3511d2b2c4014889ae449a05344ff57d"}]}] May 26 17:13:03.926041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-VolumesActionsTest-1979607197 May 26 17:13:03.926041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: 3511d2b2c4014889ae449a05344ff57d May 26 17:13:03.926041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-VolumesActionsTest-1979607197 May 26 17:13:03.926041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-VolumesActionsTest-1979607197-project May 26 17:13:03.926041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:13:03.926041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:13:03.926041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 21c11bd00fde4b6a914ce707a502784a May 26 17:13:03.926041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-VolumesActionsTest-1979607197-project May 26 17:13:03.926041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:13:03.926041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance 6530a9f7-ce70-4a6d-bf14-aeb2155d1931 could not be found. May 26 17:13:03.926041 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': '6530a9f7-ce70-4a6d-bf14-aeb2155d1931'} May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6530a9f7-ce70-4a6d-bf14-aeb2155d1931 could not be found. May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:13:03.926917 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6530a9f7-ce70-4a6d-bf14-aeb2155d1931 could not be found. May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6530a9f7-ce70-4a6d-bf14-aeb2155d1931 could not be found. May 26 17:13:03.928287 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:13:03.929605 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-5b42e5da-0e04-4bb0-98dc-7fa4aa54871c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] Returning 404 to user: Instance 6530a9f7-ce70-4a6d-bf14-aeb2155d1931 could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:13:03.929605 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-5b42e5da-0e04-4bb0-98dc-7fa4aa54871c tempest-VolumesActionsTest-1979607197 tempest-VolumesActionsTest-1979607197-project] 10.222.0.112 "GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931" status: 404 len: 111 microversion: 2.1 time: 0.032357 May 26 17:13:03.929605 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 730/1479] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:03 2022] GET /compute/v2.1/servers/6530a9f7-ce70-4a6d-bf14-aeb2155d1931 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:13:22.850486 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-f2cc4c48-c1b9-4893-af47-1193d338b0a9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:22.851017 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f2cc4c48-c1b9-4893-af47-1193d338b0a9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:22.855652 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:22.856419 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:22.871241 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-44f6357d-b37f-4f10-ad2f-507a504d71a0 req-d1d7cf0a-3e64-4f2f-831c-5badd758f269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e658131-bdbf-45c9-ade8-47d384a77f9a", "tag": "d0ed49f3-1a6a-48c4-be97-4787d5d53277"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:13:22.885819 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f2cc4c48-c1b9-4893-af47-1193d338b0a9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:22.888412 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=27 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:22.888578 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f2cc4c48-c1b9-4893-af47-1193d338b0a9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:22.890438 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f2cc4c48-c1b9-4893-af47-1193d338b0a9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:22.891672 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=21 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:22.892441 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-f2cc4c48-c1b9-4893-af47-1193d338b0a9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:22.895162 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-44f6357d-b37f-4f10-ad2f-507a504d71a0 req-d1d7cf0a-3e64-4f2f-831c-5badd758f269 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:22.895690 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-44f6357d-b37f-4f10-ad2f-507a504d71a0 req-d1d7cf0a-3e64-4f2f-831c-5badd758f269 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:22.935652 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-44f6357d-b37f-4f10-ad2f-507a504d71a0 req-d1d7cf0a-3e64-4f2f-831c-5badd758f269 service nova] Creating event network-changed:d0ed49f3-1a6a-48c4-be97-4787d5d53277 for instance 5e658131-bdbf-45c9-ade8-47d384a77f9a on hv-cinder-83607 May 26 17:13:22.945665 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-44f6357d-b37f-4f10-ad2f-507a504d71a0 req-d1d7cf0a-3e64-4f2f-831c-5badd758f269 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079186 May 26 17:13:22.951635 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-f2cc4c48-c1b9-4893-af47-1193d338b0a9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Going to try to terminate instance {{(pid=130526) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:13:22.955167 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 731/1480] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 26 17:13:23.324490 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-f2cc4c48-c1b9-4893-af47-1193d338b0a9 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "DELETE /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 204 len: 0 microversion: 2.1 time: 0.479603 May 26 17:13:23.325231 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 750/1481] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:13:22 2022] DELETE /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:13:23.334885 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-14832ac6-cf6f-4b3f-8d01-8f45d1c8eaae tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:23.336093 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-14832ac6-cf6f-4b3f-8d01-8f45d1c8eaae tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:23.344609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-14832ac6-cf6f-4b3f-8d01-8f45d1c8eaae tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:23.345108 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-14832ac6-cf6f-4b3f-8d01-8f45d1c8eaae tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:23.345964 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-14832ac6-cf6f-4b3f-8d01-8f45d1c8eaae tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:23.346428 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-14832ac6-cf6f-4b3f-8d01-8f45d1c8eaae tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:23.487245 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-14832ac6-cf6f-4b3f-8d01-8f45d1c8eaae tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:23.494833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-14832ac6-cf6f-4b3f-8d01-8f45d1c8eaae tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.164619 May 26 17:13:23.495616 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 732/1482] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:23 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:24.512963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-db7c2c1f-6fd7-4b84-bb38-27c9209abbee tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:24.513691 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-db7c2c1f-6fd7-4b84-bb38-27c9209abbee tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:24.521541 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-db7c2c1f-6fd7-4b84-bb38-27c9209abbee tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:24.522304 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-db7c2c1f-6fd7-4b84-bb38-27c9209abbee tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:24.523297 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-db7c2c1f-6fd7-4b84-bb38-27c9209abbee tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:24.523747 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-db7c2c1f-6fd7-4b84-bb38-27c9209abbee tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:24.670100 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-db7c2c1f-6fd7-4b84-bb38-27c9209abbee tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:24.678695 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-db7c2c1f-6fd7-4b84-bb38-27c9209abbee tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.169909 May 26 17:13:24.679272 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 751/1483] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:24 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:25.697659 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e15265fb-ff14-4357-afab-285fbfc6bcfb tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:25.698382 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e15265fb-ff14-4357-afab-285fbfc6bcfb tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:25.706789 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e15265fb-ff14-4357-afab-285fbfc6bcfb tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:25.707914 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e15265fb-ff14-4357-afab-285fbfc6bcfb tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:25.709544 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e15265fb-ff14-4357-afab-285fbfc6bcfb tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:25.710094 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e15265fb-ff14-4357-afab-285fbfc6bcfb tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:25.860852 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-e15265fb-ff14-4357-afab-285fbfc6bcfb tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:25.875261 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e15265fb-ff14-4357-afab-285fbfc6bcfb tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.179684 May 26 17:13:25.876809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 733/1484] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:25 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:26.893519 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7467ce77-41c4-467d-8e8a-f883d452536a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:26.894139 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7467ce77-41c4-467d-8e8a-f883d452536a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:26.901038 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7467ce77-41c4-467d-8e8a-f883d452536a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:26.901569 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7467ce77-41c4-467d-8e8a-f883d452536a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:26.902271 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7467ce77-41c4-467d-8e8a-f883d452536a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:26.902730 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7467ce77-41c4-467d-8e8a-f883d452536a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:27.350270 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7467ce77-41c4-467d-8e8a-f883d452536a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:27.362129 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7467ce77-41c4-467d-8e8a-f883d452536a tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.472377 May 26 17:13:27.363085 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 752/1485] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:26 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:28.381294 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-504973af-e50e-4b29-b7b4-8c91c2833184 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:28.381941 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-504973af-e50e-4b29-b7b4-8c91c2833184 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:28.388596 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-504973af-e50e-4b29-b7b4-8c91c2833184 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:28.389049 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-504973af-e50e-4b29-b7b4-8c91c2833184 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:28.389830 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-504973af-e50e-4b29-b7b4-8c91c2833184 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:28.390299 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-504973af-e50e-4b29-b7b4-8c91c2833184 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:28.536948 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-504973af-e50e-4b29-b7b4-8c91c2833184 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:28.544582 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-504973af-e50e-4b29-b7b4-8c91c2833184 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.167055 May 26 17:13:28.545156 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 734/1486] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:28 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:29.565096 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a61f4511-04d8-4ea6-9ec6-ff8a57b4c1be tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:29.565721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a61f4511-04d8-4ea6-9ec6-ff8a57b4c1be tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:29.573287 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a61f4511-04d8-4ea6-9ec6-ff8a57b4c1be tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:29.573830 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a61f4511-04d8-4ea6-9ec6-ff8a57b4c1be tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:29.580067 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a61f4511-04d8-4ea6-9ec6-ff8a57b4c1be tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:29.580067 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a61f4511-04d8-4ea6-9ec6-ff8a57b4c1be tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:29.724224 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-a61f4511-04d8-4ea6-9ec6-ff8a57b4c1be tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:29.736031 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a61f4511-04d8-4ea6-9ec6-ff8a57b4c1be tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.176901 May 26 17:13:29.737132 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 753/1487] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:29 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:30.754525 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-75797d35-927e-4eda-b2d7-df1939cc776c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:30.755158 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-75797d35-927e-4eda-b2d7-df1939cc776c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:30.761560 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75797d35-927e-4eda-b2d7-df1939cc776c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:30.762007 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75797d35-927e-4eda-b2d7-df1939cc776c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:30.762861 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75797d35-927e-4eda-b2d7-df1939cc776c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:30.763297 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-75797d35-927e-4eda-b2d7-df1939cc776c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:30.899423 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-75797d35-927e-4eda-b2d7-df1939cc776c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:30.906989 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-75797d35-927e-4eda-b2d7-df1939cc776c tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.156844 May 26 17:13:30.907560 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 735/1488] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:30 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:31.924277 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bea20085-b141-4244-89cf-6f5b62743337 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:31.924802 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bea20085-b141-4244-89cf-6f5b62743337 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:31.931233 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bea20085-b141-4244-89cf-6f5b62743337 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:31.937315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bea20085-b141-4244-89cf-6f5b62743337 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:31.937315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bea20085-b141-4244-89cf-6f5b62743337 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:31.937315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bea20085-b141-4244-89cf-6f5b62743337 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:32.070099 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bea20085-b141-4244-89cf-6f5b62743337 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:32.077786 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bea20085-b141-4244-89cf-6f5b62743337 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1571 microversion: 2.1 time: 0.157488 May 26 17:13:32.078719 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 754/1489] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:31 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:33.101525 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9328f185-cd4a-4c4d-b8a1-492f975f5a27 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:33.101525 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9328f185-cd4a-4c4d-b8a1-492f975f5a27 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:33.106751 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9328f185-cd4a-4c4d-b8a1-492f975f5a27 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:33.107767 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9328f185-cd4a-4c4d-b8a1-492f975f5a27 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:33.108829 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9328f185-cd4a-4c4d-b8a1-492f975f5a27 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:33.109515 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9328f185-cd4a-4c4d-b8a1-492f975f5a27 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:33.280996 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9328f185-cd4a-4c4d-b8a1-492f975f5a27 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:33.289970 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9328f185-cd4a-4c4d-b8a1-492f975f5a27 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1452 microversion: 2.1 time: 0.197792 May 26 17:13:33.290886 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 736/1490] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:33 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1452 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:34.310996 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-754f3048-e6bd-4c25-bcb7-49539cb377ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:34.311716 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-754f3048-e6bd-4c25-bcb7-49539cb377ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:34.319776 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-754f3048-e6bd-4c25-bcb7-49539cb377ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:34.320219 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-754f3048-e6bd-4c25-bcb7-49539cb377ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:34.322036 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-754f3048-e6bd-4c25-bcb7-49539cb377ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:34.322712 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-754f3048-e6bd-4c25-bcb7-49539cb377ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:34.587459 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-754f3048-e6bd-4c25-bcb7-49539cb377ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:34.596091 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-754f3048-e6bd-4c25-bcb7-49539cb377ce tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1452 microversion: 2.1 time: 0.289023 May 26 17:13:34.599392 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 755/1491] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:34 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1452 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:34.716203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-d0d44e5e-625d-4d4e-a5e9-3e69f38e898a req-8c06ac39-bef9-40eb-a506-9e9fc1a84b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e658131-bdbf-45c9-ade8-47d384a77f9a", "name": "network-vif-deleted", "tag": "d0ed49f3-1a6a-48c4-be97-4787d5d53277"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:13:34.727378 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-d0d44e5e-625d-4d4e-a5e9-3e69f38e898a req-8c06ac39-bef9-40eb-a506-9e9fc1a84b89 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:34.727819 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-d0d44e5e-625d-4d4e-a5e9-3e69f38e898a req-8c06ac39-bef9-40eb-a506-9e9fc1a84b89 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:34.740103 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-d0d44e5e-625d-4d4e-a5e9-3e69f38e898a req-8c06ac39-bef9-40eb-a506-9e9fc1a84b89 service nova] Creating event network-vif-deleted:d0ed49f3-1a6a-48c4-be97-4787d5d53277 for instance 5e658131-bdbf-45c9-ade8-47d384a77f9a on hv-cinder-83607 May 26 17:13:34.746794 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-d0d44e5e-625d-4d4e-a5e9-3e69f38e898a req-8c06ac39-bef9-40eb-a506-9e9fc1a84b89 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034867 May 26 17:13:34.748018 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 737/1492] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:13:35.616211 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9f237707-f835-4674-be94-192c99423740 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:35.616759 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9f237707-f835-4674-be94-192c99423740 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:35.623087 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9f237707-f835-4674-be94-192c99423740 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:35.623532 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9f237707-f835-4674-be94-192c99423740 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:35.624298 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9f237707-f835-4674-be94-192c99423740 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:35.624731 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9f237707-f835-4674-be94-192c99423740 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:35.689506 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9f237707-f835-4674-be94-192c99423740 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:35.697439 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9f237707-f835-4674-be94-192c99423740 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1222 microversion: 2.1 time: 0.085129 May 26 17:13:35.698040 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 756/1493] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:35 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:36.715052 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8f7f641f-00d5-4ccc-8667-aae446410556 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:36.716490 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8f7f641f-00d5-4ccc-8667-aae446410556 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:36.724389 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f7f641f-00d5-4ccc-8667-aae446410556 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:36.725076 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f7f641f-00d5-4ccc-8667-aae446410556 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:36.726019 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f7f641f-00d5-4ccc-8667-aae446410556 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:36.726703 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f7f641f-00d5-4ccc-8667-aae446410556 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:36.764113 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f7f641f-00d5-4ccc-8667-aae446410556 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:36.765014 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8f7f641f-00d5-4ccc-8667-aae446410556 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:36.765507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-8f7f641f-00d5-4ccc-8667-aae446410556 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lazy-loading 'fault' on Instance uuid 5e658131-bdbf-45c9-ade8-47d384a77f9a {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:13:36.820192 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8f7f641f-00d5-4ccc-8667-aae446410556 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caebb88017f94b25bbbac26be1218bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac969ae313524a28b6635d82db310f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:13:36.828433 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8f7f641f-00d5-4ccc-8667-aae446410556 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 200 len: 1227 microversion: 2.1 time: 0.117411 May 26 17:13:36.839765 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 738/1494] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:36 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 1227 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:13:37.846679 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a4bd0b75-6558-4059-8dd7-a9dcfc33d463 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:37.847313 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a4bd0b75-6558-4059-8dd7-a9dcfc33d463 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] [instance: 5e658131-bdbf-45c9-ade8-47d384a77f9a] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:13:37.853955 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a4bd0b75-6558-4059-8dd7-a9dcfc33d463 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:37.854444 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a4bd0b75-6558-4059-8dd7-a9dcfc33d463 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:37.855218 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a4bd0b75-6558-4059-8dd7-a9dcfc33d463 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:13:37.855659 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a4bd0b75-6558-4059-8dd7-a9dcfc33d463 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:13:37.879675 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-a4bd0b75-6558-4059-8dd7-a9dcfc33d463 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] HTTP exception thrown: Instance 5e658131-bdbf-45c9-ade8-47d384a77f9a could not be found. May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a4bd0b75-6558-4059-8dd7-a9dcfc33d463 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Request method failure captured: May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a HTTP/1.1 May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7OV2jhh_c0R5s6zqJwlNnT-qGJJ0bSumNwhPsJHVWd0BD6zgZNgLSyZOURP-bKv7ATumu_jDDLILE-bdi7jqpg8VOVlZlX9DWcUoijbWV9ls500f1G_i0e-LkCbFTd9BVRTopf5OsTvZRfly12lESKxsRckkN6dpAvy6cZIQ0NY0Q8 May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: ac969ae313524a28b6635d82db310f97 May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-TestShelveInstance-1998689041 May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:13:37.881345 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:13:37.882983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/ac969ae313524a28b6635d82db310f97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/ac969ae313524a28b6635d82db310f97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/ac969ae313524a28b6635d82db310f97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_ac969ae313524a28b6635d82db310f97"}]}] May 26 17:13:37.882983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-TestShelveInstance-1998689041 May 26 17:13:37.882983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: ac969ae313524a28b6635d82db310f97 May 26 17:13:37.882983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-TestShelveInstance-1998689041 May 26 17:13:37.882983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-TestShelveInstance-1998689041-project May 26 17:13:37.882983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:13:37.882983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:13:37.882983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: caebb88017f94b25bbbac26be1218bc3 May 26 17:13:37.882983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-TestShelveInstance-1998689041-project May 26 17:13:37.882983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:13:37.882983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance 5e658131-bdbf-45c9-ade8-47d384a77f9a could not be found. May 26 17:13:37.882983 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': '5e658131-bdbf-45c9-ade8-47d384a77f9a'} May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e658131-bdbf-45c9-ade8-47d384a77f9a could not be found. May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:13:37.883889 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e658131-bdbf-45c9-ade8-47d384a77f9a could not be found. May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e658131-bdbf-45c9-ade8-47d384a77f9a could not be found. May 26 17:13:37.885452 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:13:37.893118 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a4bd0b75-6558-4059-8dd7-a9dcfc33d463 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Returning 404 to user: Instance 5e658131-bdbf-45c9-ade8-47d384a77f9a could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:13:37.893118 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a4bd0b75-6558-4059-8dd7-a9dcfc33d463 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a" status: 404 len: 111 microversion: 2.1 time: 0.040182 May 26 17:13:37.893118 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 757/1495] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:13:37 2022] GET /compute/v2.1/servers/5e658131-bdbf-45c9-ade8-47d384a77f9a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:13:38.115476 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-663089c1-7ade-44db-9ded-b970b4107111 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] Calling method '.version_select at 0x7fd25621a940>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:13:38.209509 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-663089c1-7ade-44db-9ded-b970b4107111 tempest-TestShelveInstance-1998689041 tempest-TestShelveInstance-1998689041-project] 10.222.0.112 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-435658207" status: 202 len: 0 microversion: 2.1 time: 0.097861 May 26 17:13:38.214074 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 739/1496] 10.222.0.112 () {58 vars in 1255 bytes} [Thu May 26 17:13:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-435658207 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:14:17.056882 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-52560178", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "networks": [{"uuid": "2324e30a-a891-4528-b047-26cf1efff5c4"}]}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:14:17.063752 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:17.069660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:17.111464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.network.neutron [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] validate_networks() for [('2324e30a-a891-4528-b047-26cf1efff5c4', None, None, None, None, None)] {{(pid=130526) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:14:17.461806 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Flavor limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:14:17.462220 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Image limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:14:17.462718 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Flavor pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:14:17.463123 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Image pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:14:17.463557 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:14:17.472387 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:17.472880 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:17.473667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:17.474173 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:17.495286 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Getting quotas for project b3bbc230c5914635ba995b16e43059f7. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:14:17.499292 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Getting quotas for user 80fa321f3ac1448681e4191ff04b47a2 and project b3bbc230c5914635ba995b16e43059f7. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:14:17.510912 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Going to run 1 instances... {{(pid=130526) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:14:17.513151 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:14:17.648921 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-a14436d0-80d9-4daa-ac2f-ab143898d202 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.595920 May 26 17:14:17.649684 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 758/1497] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:14:17 2022] POST /compute/v2.1/servers => generated 382 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:14:17.659533 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0310d40f-dd51-4fb6-bf88-de2eee234651 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:17.660142 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0310d40f-dd51-4fb6-bf88-de2eee234651 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:17.662448 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=42 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:17.663130 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:17.717737 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0310d40f-dd51-4fb6-bf88-de2eee234651 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:17.725017 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0310d40f-dd51-4fb6-bf88-de2eee234651 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1221 microversion: 2.1 time: 0.069246 May 26 17:14:17.725513 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 740/1498] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:17 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1221 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:18.742588 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-58094065-e979-431e-961d-a80778061870 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:18.743207 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-58094065-e979-431e-961d-a80778061870 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:18.795863 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-58094065-e979-431e-961d-a80778061870 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:18.802952 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-58094065-e979-431e-961d-a80778061870 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1221 microversion: 2.1 time: 0.064652 May 26 17:14:18.803653 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 759/1499] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:18 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:19.821260 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ccea13c6-f78a-4105-a3ee-8abe1606cd2f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:19.821909 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ccea13c6-f78a-4105-a3ee-8abe1606cd2f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:19.877483 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ccea13c6-f78a-4105-a3ee-8abe1606cd2f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:19.884964 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ccea13c6-f78a-4105-a3ee-8abe1606cd2f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1221 microversion: 2.1 time: 0.068141 May 26 17:14:19.894279 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 741/1500] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:19 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:20.901855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4179623e-34c8-4164-86c1-915709f81b2e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:20.902518 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4179623e-34c8-4164-86c1-915709f81b2e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:20.955401 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-4179623e-34c8-4164-86c1-915709f81b2e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:20.962384 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4179623e-34c8-4164-86c1-915709f81b2e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1221 microversion: 2.1 time: 0.064513 May 26 17:14:20.962936 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 760/1501] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:20 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:21.982637 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0b39c0bd-829f-44eb-98ab-18e5228043b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:21.982637 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0b39c0bd-829f-44eb-98ab-18e5228043b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:21.987150 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0b39c0bd-829f-44eb-98ab-18e5228043b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:21.987601 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0b39c0bd-829f-44eb-98ab-18e5228043b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:21.988374 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0b39c0bd-829f-44eb-98ab-18e5228043b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:21.988812 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0b39c0bd-829f-44eb-98ab-18e5228043b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:22.052416 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-0b39c0bd-829f-44eb-98ab-18e5228043b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:22.060369 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0b39c0bd-829f-44eb-98ab-18e5228043b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1225 microversion: 2.1 time: 0.085095 May 26 17:14:22.060938 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 742/1502] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:21 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:23.077121 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-9436bd52-eb5b-4f84-b554-0d6f42b06e61 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:23.077722 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-9436bd52-eb5b-4f84-b554-0d6f42b06e61 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:23.084523 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9436bd52-eb5b-4f84-b554-0d6f42b06e61 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:23.085009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9436bd52-eb5b-4f84-b554-0d6f42b06e61 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:23.086396 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9436bd52-eb5b-4f84-b554-0d6f42b06e61 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:23.086837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-9436bd52-eb5b-4f84-b554-0d6f42b06e61 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:23.147890 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-9436bd52-eb5b-4f84-b554-0d6f42b06e61 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:23.156375 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-9436bd52-eb5b-4f84-b554-0d6f42b06e61 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1225 microversion: 2.1 time: 0.083263 May 26 17:14:23.156948 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 761/1503] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:23 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:24.174725 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4a147b0c-3092-4fcd-996c-dbf81648bdf0 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:24.175335 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4a147b0c-3092-4fcd-996c-dbf81648bdf0 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:24.184310 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a147b0c-3092-4fcd-996c-dbf81648bdf0 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:24.184752 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a147b0c-3092-4fcd-996c-dbf81648bdf0 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:24.185523 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a147b0c-3092-4fcd-996c-dbf81648bdf0 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:24.185983 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4a147b0c-3092-4fcd-996c-dbf81648bdf0 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:24.289778 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4a147b0c-3092-4fcd-996c-dbf81648bdf0 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:24.297763 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4a147b0c-3092-4fcd-996c-dbf81648bdf0 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1281 microversion: 2.1 time: 0.127148 May 26 17:14:24.298805 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 743/1504] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:24 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1281 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:25.315657 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3b4f1ee8-3d11-41ba-ab37-b6a8497d4a75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:25.316288 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3b4f1ee8-3d11-41ba-ab37-b6a8497d4a75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:25.322913 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3b4f1ee8-3d11-41ba-ab37-b6a8497d4a75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:25.323361 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3b4f1ee8-3d11-41ba-ab37-b6a8497d4a75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:25.324119 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3b4f1ee8-3d11-41ba-ab37-b6a8497d4a75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:25.324548 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3b4f1ee8-3d11-41ba-ab37-b6a8497d4a75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:25.455576 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3b4f1ee8-3d11-41ba-ab37-b6a8497d4a75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:25.463924 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3b4f1ee8-3d11-41ba-ab37-b6a8497d4a75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.152240 May 26 17:14:25.464489 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 762/1505] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:25 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:25.895621 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-a4b7a294-af19-4493-8a24-091cdec4e55d req-4b3e9478-cf09-439a-b5bc-9b2cb08f819f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d45d73-017e-4647-a2c0-4c52d4a7813b", "tag": "c08db976-17e3-480e-9c91-022d2a3677c2"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:14:25.905128 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-a4b7a294-af19-4493-8a24-091cdec4e55d req-4b3e9478-cf09-439a-b5bc-9b2cb08f819f service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:25.905573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-a4b7a294-af19-4493-8a24-091cdec4e55d req-4b3e9478-cf09-439a-b5bc-9b2cb08f819f service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:25.917078 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-a4b7a294-af19-4493-8a24-091cdec4e55d req-4b3e9478-cf09-439a-b5bc-9b2cb08f819f service nova] Creating event network-changed:c08db976-17e3-480e-9c91-022d2a3677c2 for instance 52d45d73-017e-4647-a2c0-4c52d4a7813b on hv-cinder-83607 May 26 17:14:25.921906 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-a4b7a294-af19-4493-8a24-091cdec4e55d req-4b3e9478-cf09-439a-b5bc-9b2cb08f819f service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030212 May 26 17:14:25.922664 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 744/1506] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:14:26.481135 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-3596c810-5ee1-4c97-96b5-3ce37790877e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:26.481748 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-3596c810-5ee1-4c97-96b5-3ce37790877e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:26.488447 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3596c810-5ee1-4c97-96b5-3ce37790877e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:26.488901 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3596c810-5ee1-4c97-96b5-3ce37790877e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:26.489667 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3596c810-5ee1-4c97-96b5-3ce37790877e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:26.490108 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-3596c810-5ee1-4c97-96b5-3ce37790877e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:26.633746 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-3596c810-5ee1-4c97-96b5-3ce37790877e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:26.641259 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-3596c810-5ee1-4c97-96b5-3ce37790877e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.164051 May 26 17:14:26.641826 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 763/1507] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:26 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:27.658628 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b4f28aa2-380b-4caf-9ff9-5e5f9735b30f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:27.659355 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b4f28aa2-380b-4caf-9ff9-5e5f9735b30f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:27.665961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b4f28aa2-380b-4caf-9ff9-5e5f9735b30f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:27.666447 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b4f28aa2-380b-4caf-9ff9-5e5f9735b30f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:27.667210 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b4f28aa2-380b-4caf-9ff9-5e5f9735b30f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:27.667644 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b4f28aa2-380b-4caf-9ff9-5e5f9735b30f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:27.800106 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b4f28aa2-380b-4caf-9ff9-5e5f9735b30f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:27.808274 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b4f28aa2-380b-4caf-9ff9-5e5f9735b30f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.154318 May 26 17:14:27.808845 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 745/1508] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:27 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:28.827942 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-54a49876-348b-4300-9554-2a1a5aef9989 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:28.829143 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-54a49876-348b-4300-9554-2a1a5aef9989 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:28.831380 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:28.837818 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54a49876-348b-4300-9554-2a1a5aef9989 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:28.838255 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54a49876-348b-4300-9554-2a1a5aef9989 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:28.839039 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54a49876-348b-4300-9554-2a1a5aef9989 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:28.839464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-54a49876-348b-4300-9554-2a1a5aef9989 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:28.970572 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-54a49876-348b-4300-9554-2a1a5aef9989 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:28.977974 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-54a49876-348b-4300-9554-2a1a5aef9989 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.156079 May 26 17:14:28.978584 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 764/1509] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:28 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:29.995426 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f23481b3-fd7b-4798-a9dd-52e62652f4a8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:29.996032 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f23481b3-fd7b-4798-a9dd-52e62652f4a8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:29.998396 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=4 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:30.003220 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f23481b3-fd7b-4798-a9dd-52e62652f4a8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:30.003654 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f23481b3-fd7b-4798-a9dd-52e62652f4a8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:30.004397 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f23481b3-fd7b-4798-a9dd-52e62652f4a8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:30.004818 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f23481b3-fd7b-4798-a9dd-52e62652f4a8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:30.136521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f23481b3-fd7b-4798-a9dd-52e62652f4a8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:30.143960 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f23481b3-fd7b-4798-a9dd-52e62652f4a8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.152886 May 26 17:14:30.144529 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 746/1510] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:29 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:31.160996 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b7d143cc-e2d6-48ea-87ed-45d5811d692d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:31.161595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b7d143cc-e2d6-48ea-87ed-45d5811d692d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:31.164289 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=10 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:31.169228 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b7d143cc-e2d6-48ea-87ed-45d5811d692d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:31.169685 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b7d143cc-e2d6-48ea-87ed-45d5811d692d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:31.170504 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b7d143cc-e2d6-48ea-87ed-45d5811d692d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:31.170942 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b7d143cc-e2d6-48ea-87ed-45d5811d692d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:31.307622 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b7d143cc-e2d6-48ea-87ed-45d5811d692d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:31.315147 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b7d143cc-e2d6-48ea-87ed-45d5811d692d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.158064 May 26 17:14:31.315721 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 765/1511] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:31 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:32.333023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ca462fbb-0ba1-4271-9fbf-377c4ff6de9c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:32.333990 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ca462fbb-0ba1-4271-9fbf-377c4ff6de9c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:32.340896 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ca462fbb-0ba1-4271-9fbf-377c4ff6de9c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:32.341372 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ca462fbb-0ba1-4271-9fbf-377c4ff6de9c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:32.342148 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ca462fbb-0ba1-4271-9fbf-377c4ff6de9c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:32.342713 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-ca462fbb-0ba1-4271-9fbf-377c4ff6de9c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:32.476903 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ca462fbb-0ba1-4271-9fbf-377c4ff6de9c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:32.484412 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ca462fbb-0ba1-4271-9fbf-377c4ff6de9c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.155190 May 26 17:14:32.484983 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 747/1512] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:32 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:33.502099 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-dcc5f93e-d7cb-4c76-996b-c219e34bca37 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:33.502654 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-dcc5f93e-d7cb-4c76-996b-c219e34bca37 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:33.510073 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dcc5f93e-d7cb-4c76-996b-c219e34bca37 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:33.510551 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dcc5f93e-d7cb-4c76-996b-c219e34bca37 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:33.511324 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dcc5f93e-d7cb-4c76-996b-c219e34bca37 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:33.511812 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-dcc5f93e-d7cb-4c76-996b-c219e34bca37 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:33.649865 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-dcc5f93e-d7cb-4c76-996b-c219e34bca37 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:33.657225 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-dcc5f93e-d7cb-4c76-996b-c219e34bca37 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.159022 May 26 17:14:33.657984 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 766/1513] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:33 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:34.405436 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-55bb277a-c182-46bd-9e2d-21dc6ada497e req-93e14d53-eab2-4c78-b4ef-2b434a26b474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d45d73-017e-4647-a2c0-4c52d4a7813b", "name": "network-vif-plugged", "status": "completed", "tag": "c08db976-17e3-480e-9c91-022d2a3677c2"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:14:34.414032 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-55bb277a-c182-46bd-9e2d-21dc6ada497e req-93e14d53-eab2-4c78-b4ef-2b434a26b474 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:34.414032 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-55bb277a-c182-46bd-9e2d-21dc6ada497e req-93e14d53-eab2-4c78-b4ef-2b434a26b474 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:34.426228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-55bb277a-c182-46bd-9e2d-21dc6ada497e req-93e14d53-eab2-4c78-b4ef-2b434a26b474 service nova] Creating event network-vif-plugged:c08db976-17e3-480e-9c91-022d2a3677c2 for instance 52d45d73-017e-4647-a2c0-4c52d4a7813b on hv-cinder-83607 May 26 17:14:34.431805 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-55bb277a-c182-46bd-9e2d-21dc6ada497e req-93e14d53-eab2-4c78-b4ef-2b434a26b474 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150896 May 26 17:14:34.432471 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 748/1514] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:14:34.674643 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-bdb1a95d-95e2-4a1a-8f70-746ac549104b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:34.675235 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-bdb1a95d-95e2-4a1a-8f70-746ac549104b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:34.681879 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bdb1a95d-95e2-4a1a-8f70-746ac549104b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:34.682348 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bdb1a95d-95e2-4a1a-8f70-746ac549104b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:34.683185 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bdb1a95d-95e2-4a1a-8f70-746ac549104b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:34.683685 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-bdb1a95d-95e2-4a1a-8f70-746ac549104b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:34.814469 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-bdb1a95d-95e2-4a1a-8f70-746ac549104b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:34.822589 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-bdb1a95d-95e2-4a1a-8f70-746ac549104b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.151982 May 26 17:14:34.823167 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 767/1515] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:34 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:35.214935 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:14:35.215145 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Thu May 26 17:14:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:14:35.841168 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-9d285759-f2ea-41ef-9b89-e3167b002884 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:35.841850 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-9d285759-f2ea-41ef-9b89-e3167b002884 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:35.848247 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9d285759-f2ea-41ef-9b89-e3167b002884 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:35.848681 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9d285759-f2ea-41ef-9b89-e3167b002884 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:35.849448 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9d285759-f2ea-41ef-9b89-e3167b002884 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:35.849882 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-9d285759-f2ea-41ef-9b89-e3167b002884 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:35.988209 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-9d285759-f2ea-41ef-9b89-e3167b002884 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:35.995659 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-9d285759-f2ea-41ef-9b89-e3167b002884 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.159863 May 26 17:14:35.996226 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 749/1516] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:35 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:37.012735 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-7d2c55b1-a4cc-4292-abd3-552ed8eb37db tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:37.013355 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-7d2c55b1-a4cc-4292-abd3-552ed8eb37db tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:37.019855 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7d2c55b1-a4cc-4292-abd3-552ed8eb37db tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:37.020297 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7d2c55b1-a4cc-4292-abd3-552ed8eb37db tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:37.021051 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7d2c55b1-a4cc-4292-abd3-552ed8eb37db tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:37.021483 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-7d2c55b1-a4cc-4292-abd3-552ed8eb37db tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:37.150886 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-7d2c55b1-a4cc-4292-abd3-552ed8eb37db tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:37.158315 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-7d2c55b1-a4cc-4292-abd3-552ed8eb37db tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.150071 May 26 17:14:37.162506 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 768/1517] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:37 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:38.176409 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-edcc99f1-9a80-4e09-912c-12dd1727945f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:38.177042 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-edcc99f1-9a80-4e09-912c-12dd1727945f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:38.184525 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-edcc99f1-9a80-4e09-912c-12dd1727945f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:38.184976 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-edcc99f1-9a80-4e09-912c-12dd1727945f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:38.185731 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-edcc99f1-9a80-4e09-912c-12dd1727945f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:38.186159 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-edcc99f1-9a80-4e09-912c-12dd1727945f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:38.314938 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-edcc99f1-9a80-4e09-912c-12dd1727945f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:38.322827 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-edcc99f1-9a80-4e09-912c-12dd1727945f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.150244 May 26 17:14:38.323399 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 750/1518] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:38 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:39.340508 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b60196e6-73d1-40f5-85a8-853f0574294a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:39.341208 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b60196e6-73d1-40f5-85a8-853f0574294a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:39.347607 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b60196e6-73d1-40f5-85a8-853f0574294a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:39.348053 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b60196e6-73d1-40f5-85a8-853f0574294a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:39.348812 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b60196e6-73d1-40f5-85a8-853f0574294a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:39.349244 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b60196e6-73d1-40f5-85a8-853f0574294a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:39.483959 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b60196e6-73d1-40f5-85a8-853f0574294a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:39.491342 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b60196e6-73d1-40f5-85a8-853f0574294a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.155303 May 26 17:14:39.491893 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 769/1519] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:39 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:40.508323 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-a54ff715-ed42-4622-9aff-075d03e4d044 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:40.508939 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-a54ff715-ed42-4622-9aff-075d03e4d044 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:40.515160 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a54ff715-ed42-4622-9aff-075d03e4d044 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:40.515609 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a54ff715-ed42-4622-9aff-075d03e4d044 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:40.516371 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a54ff715-ed42-4622-9aff-075d03e4d044 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:40.516810 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-a54ff715-ed42-4622-9aff-075d03e4d044 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:40.653152 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-a54ff715-ed42-4622-9aff-075d03e4d044 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:40.658712 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-a54ff715-ed42-4622-9aff-075d03e4d044 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1321 microversion: 2.1 time: 0.154074 May 26 17:14:40.659521 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 751/1520] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:40 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:14:41.676772 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-aabf49ae-0380-490b-8503-8b09c2160382 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:14:41.677382 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-aabf49ae-0380-490b-8503-8b09c2160382 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:14:41.684552 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aabf49ae-0380-490b-8503-8b09c2160382 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:41.684998 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aabf49ae-0380-490b-8503-8b09c2160382 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:41.685785 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aabf49ae-0380-490b-8503-8b09c2160382 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:14:41.686248 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-aabf49ae-0380-490b-8503-8b09c2160382 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:14:41.813000 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-aabf49ae-0380-490b-8503-8b09c2160382 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:14:41.820506 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-aabf49ae-0380-490b-8503-8b09c2160382 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1510 microversion: 2.1 time: 0.147612 May 26 17:14:41.821071 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 770/1521] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:14:41 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:15:17.347638 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fce16cba-e6a5-4e12-a2d4-ad6176b1d88b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4b618b2-c59a-49d6-8f05-0b821cca211c", "device": "/dev/sdb"}} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:15:17.349228 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fce16cba-e6a5-4e12-a2d4-ad6176b1d88b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:15:17.351382 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=28 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:17.352038 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=52 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:17.357272 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fce16cba-e6a5-4e12-a2d4-ad6176b1d88b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:17.357714 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fce16cba-e6a5-4e12-a2d4-ad6176b1d88b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:17.358508 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fce16cba-e6a5-4e12-a2d4-ad6176b1d88b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:17.358947 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fce16cba-e6a5-4e12-a2d4-ad6176b1d88b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:18.173416 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fce16cba-e6a5-4e12-a2d4-ad6176b1d88b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "POST /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.829715 May 26 17:15:18.174125 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 752/1522] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:15:17 2022] POST /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b/os-volume_attachments => generated 194 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:15:53.215450 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:53.216232 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=62 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:53.220311 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-4a9e221b-653e-46d4-9efa-e317f64be8c8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:15:53.220802 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-4a9e221b-653e-46d4-9efa-e317f64be8c8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:15:53.226837 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4a9e221b-653e-46d4-9efa-e317f64be8c8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:53.228373 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4a9e221b-653e-46d4-9efa-e317f64be8c8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:53.228373 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4a9e221b-653e-46d4-9efa-e317f64be8c8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:53.228659 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-4a9e221b-653e-46d4-9efa-e317f64be8c8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:53.313187 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.objects.instance [None req-4a9e221b-653e-46d4-9efa-e317f64be8c8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lazy-loading 'services' on Instance uuid 52d45d73-017e-4647-a2c0-4c52d4a7813b {{(pid=130526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:15:53.512093 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-4a9e221b-653e-46d4-9efa-e317f64be8c8 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "DELETE /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b/os-volume_attachments/c4b618b2-c59a-49d6-8f05-0b821cca211c" status: 202 len: 0 microversion: 2.1 time: 0.298121 May 26 17:15:53.512693 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 771/1523] 10.222.0.112 () {58 vars in 1420 bytes} [Thu May 26 17:15:53 2022] DELETE /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b/os-volume_attachments/c4b618b2-c59a-49d6-8f05-0b821cca211c => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:15:55.690730 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:55.691565 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:55.695616 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-0aeda275-2982-4c82-8977-2a37dadc115f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:15:55.696203 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0aeda275-2982-4c82-8977-2a37dadc115f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:15:55.702231 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0aeda275-2982-4c82-8977-2a37dadc115f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:55.702709 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0aeda275-2982-4c82-8977-2a37dadc115f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:55.703469 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0aeda275-2982-4c82-8977-2a37dadc115f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:55.703905 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-0aeda275-2982-4c82-8977-2a37dadc115f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:55.730020 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-0aeda275-2982-4c82-8977-2a37dadc115f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Going to try to terminate instance {{(pid=130525) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:15:56.057627 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-0aeda275-2982-4c82-8977-2a37dadc115f tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "DELETE /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 204 len: 0 microversion: 2.1 time: 0.368122 May 26 17:15:56.058256 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 753/1524] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:15:55 2022] DELETE /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:15:56.067467 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-41dc7c02-d051-42be-a113-ed3ceb645ab2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:15:56.080205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-41dc7c02-d051-42be-a113-ed3ceb645ab2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:15:56.080205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41dc7c02-d051-42be-a113-ed3ceb645ab2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:56.080205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41dc7c02-d051-42be-a113-ed3ceb645ab2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:56.080205 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41dc7c02-d051-42be-a113-ed3ceb645ab2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:56.080635 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-41dc7c02-d051-42be-a113-ed3ceb645ab2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:56.208154 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-41dc7c02-d051-42be-a113-ed3ceb645ab2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:15:56.217448 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-41dc7c02-d051-42be-a113-ed3ceb645ab2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1516 microversion: 2.1 time: 0.154767 May 26 17:15:56.218016 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 772/1525] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:15:56 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:15:57.235629 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-fa00e609-ba3d-44dd-9b00-b8b50979fbdc tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:15:57.236330 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-fa00e609-ba3d-44dd-9b00-b8b50979fbdc tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:15:57.243339 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa00e609-ba3d-44dd-9b00-b8b50979fbdc tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:57.243784 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa00e609-ba3d-44dd-9b00-b8b50979fbdc tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:57.244545 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa00e609-ba3d-44dd-9b00-b8b50979fbdc tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:57.244977 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-fa00e609-ba3d-44dd-9b00-b8b50979fbdc tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:57.376361 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-fa00e609-ba3d-44dd-9b00-b8b50979fbdc tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:15:57.383908 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-fa00e609-ba3d-44dd-9b00-b8b50979fbdc tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1516 microversion: 2.1 time: 0.152681 May 26 17:15:57.384487 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 754/1526] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:15:57 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:15:58.401725 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-36bf3877-b2bd-4fcc-a44b-44ae85ca9d6c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:15:58.402355 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-36bf3877-b2bd-4fcc-a44b-44ae85ca9d6c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:15:58.409023 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-36bf3877-b2bd-4fcc-a44b-44ae85ca9d6c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:58.409500 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-36bf3877-b2bd-4fcc-a44b-44ae85ca9d6c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:58.410263 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-36bf3877-b2bd-4fcc-a44b-44ae85ca9d6c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:58.410720 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-36bf3877-b2bd-4fcc-a44b-44ae85ca9d6c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:58.538370 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-36bf3877-b2bd-4fcc-a44b-44ae85ca9d6c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:15:58.546812 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-36bf3877-b2bd-4fcc-a44b-44ae85ca9d6c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1516 microversion: 2.1 time: 0.149589 May 26 17:15:58.547363 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 773/1527] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:15:58 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:15:59.336884 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-5045fc0f-0654-46bc-a539-6d69e313d6ed req-1701eeb1-1eeb-4c7e-9050-2757aaa7c126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d45d73-017e-4647-a2c0-4c52d4a7813b", "name": "network-vif-deleted", "tag": "c08db976-17e3-480e-9c91-022d2a3677c2"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:15:59.345565 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-5045fc0f-0654-46bc-a539-6d69e313d6ed req-1701eeb1-1eeb-4c7e-9050-2757aaa7c126 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:59.346010 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-5045fc0f-0654-46bc-a539-6d69e313d6ed req-1701eeb1-1eeb-4c7e-9050-2757aaa7c126 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:59.360271 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-5045fc0f-0654-46bc-a539-6d69e313d6ed req-1701eeb1-1eeb-4c7e-9050-2757aaa7c126 service nova] Creating event network-vif-deleted:c08db976-17e3-480e-9c91-022d2a3677c2 for instance 52d45d73-017e-4647-a2c0-4c52d4a7813b on hv-cinder-83607 May 26 17:15:59.365338 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-5045fc0f-0654-46bc-a539-6d69e313d6ed req-1701eeb1-1eeb-4c7e-9050-2757aaa7c126 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032529 May 26 17:15:59.365994 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 755/1528] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:15:59.565068 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-251d82be-bf77-45bf-944c-f245e404d8c1 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:15:59.566970 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-251d82be-bf77-45bf-944c-f245e404d8c1 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:15:59.572275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-251d82be-bf77-45bf-944c-f245e404d8c1 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:59.572712 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-251d82be-bf77-45bf-944c-f245e404d8c1 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:59.573467 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-251d82be-bf77-45bf-944c-f245e404d8c1 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:15:59.573896 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-251d82be-bf77-45bf-944c-f245e404d8c1 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:15:59.640255 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-251d82be-bf77-45bf-944c-f245e404d8c1 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:15:59.648801 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-251d82be-bf77-45bf-944c-f245e404d8c1 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 200 len: 1306 microversion: 2.1 time: 0.087500 May 26 17:15:59.649406 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 774/1529] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:15:59 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 1306 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:00.668505 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-99f15e68-093b-4080-a0e4-f40c34422d82 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:00.669198 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-99f15e68-093b-4080-a0e4-f40c34422d82 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: 52d45d73-017e-4647-a2c0-4c52d4a7813b] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:00.675351 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-99f15e68-093b-4080-a0e4-f40c34422d82 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:00.675792 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-99f15e68-093b-4080-a0e4-f40c34422d82 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:00.676554 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-99f15e68-093b-4080-a0e4-f40c34422d82 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:00.676982 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-99f15e68-093b-4080-a0e4-f40c34422d82 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:00.848246 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.wsgi [None req-99f15e68-093b-4080-a0e4-f40c34422d82 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] HTTP exception thrown: Instance 52d45d73-017e-4647-a2c0-4c52d4a7813b could not be found. May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-99f15e68-093b-4080-a0e4-f40c34422d82 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Request method failure captured: May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: request: GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b HTTP/1.1 May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept: application/json May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Accept-Encoding: identity May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Connection: close May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Length: 0 May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Content-Type: application/json May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Host: 10.222.0.112 May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Openstack-System-Scope: None May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: User-Agent: python-urllib3/1.26.9 May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Auth-Token: gAAAAABij7Vmk1Hp0Z2ehpTP50yukMtlHrQ35WFN0KEqoVFadsw4EOPylgN12DCXWtAZNJrZlO04J79DATr6fd_RmHSsN3dB-GTVS1SS5WZC3nTCs96GAQ3VzfEbyD1sKZ6PciNMx5cNN451UwGNdmr1faDwW-YwG__snC1LUOOMpcJ6VBF7Fsg May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Id: None May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Domain-Name: None May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Identity-Status: Confirmed May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Is-Admin-Project: True May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Id: default May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Domain-Name: Default May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Id: b3bbc230c5914635ba995b16e43059f7 May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1208611973 May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Role: reader,member May 26 17:16:00.849971 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Roles: reader,member May 26 17:16:00.851863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/b3bbc230c5914635ba995b16e43059f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/b3bbc230c5914635ba995b16e43059f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/b3bbc230c5914635ba995b16e43059f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_b3bbc230c5914635ba995b16e43059f7"}]}] May 26 17:16:00.851863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant: tempest-VolumesSnapshotTestJSON-1208611973 May 26 17:16:00.851863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Id: b3bbc230c5914635ba995b16e43059f7 May 26 17:16:00.851863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1208611973 May 26 17:16:00.851863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User: tempest-VolumesSnapshotTestJSON-1208611973-project May 26 17:16:00.851863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Id: default May 26 17:16:00.851863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Domain-Name: Default May 26 17:16:00.851863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Id: 80fa321f3ac1448681e4191ff04b47a2 May 26 17:16:00.851863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: X-User-Name: tempest-VolumesSnapshotTestJSON-1208611973-project May 26 17:16:00.851863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: method: > May 26 17:16:00.851863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: exception: Instance 52d45d73-017e-4647-a2c0-4c52d4a7813b could not be found. May 26 17:16:00.851863 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: action_args: {'id': '52d45d73-017e-4647-a2c0-4c52d4a7813b'} May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d45d73-017e-4647-a2c0-4c52d4a7813b could not be found. May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:16:00.853537 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d45d73-017e-4647-a2c0-4c52d4a7813b could not be found. May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d45d73-017e-4647-a2c0-4c52d4a7813b could not be found. May 26 17:16:00.855573 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: ERROR nova.api.openstack.wsgi May 26 17:16:00.857106 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-99f15e68-093b-4080-a0e4-f40c34422d82 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Returning 404 to user: Instance 52d45d73-017e-4647-a2c0-4c52d4a7813b could not be found. {{(pid=130525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:16:00.857106 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-99f15e68-093b-4080-a0e4-f40c34422d82 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b" status: 404 len: 111 microversion: 2.1 time: 0.188401 May 26 17:16:00.857106 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 756/1530] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:00 2022] GET /compute/v2.1/servers/52d45d73-017e-4647-a2c0-4c52d4a7813b => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:16:13.393996 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1416304652", "imageRef": "bfe7c055-64bb-4beb-a362-cc78f2e671cc", "flavorRef": "452", "networks": [{"uuid": "2324e30a-a891-4528-b047-26cf1efff5c4"}]}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:16:13.401275 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=8 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:13.402072 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:13.446873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.network.neutron [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] validate_networks() for [('2324e30a-a891-4528-b047-26cf1efff5c4', None, None, None, None, None)] {{(pid=130526) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:16:13.783619 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Flavor limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:16:13.784043 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Image limits 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:16:13.784516 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Flavor pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:16:13.784923 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Image pref 0:0:0 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:16:13.785332 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.virt.hardware [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:16:13.795508 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:13.795957 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:13.796749 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:13.797184 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:13.814406 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Getting quotas for project b3bbc230c5914635ba995b16e43059f7. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:16:13.818262 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.quota [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Getting quotas for user 80fa321f3ac1448681e4191ff04b47a2 and project b3bbc230c5914635ba995b16e43059f7. Resources: {'cores', 'ram', 'instances'} {{(pid=130526) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:16:13.830144 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Going to run 1 instances... {{(pid=130526) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:16:13.832417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfe7c055-64bb-4beb-a362-cc78f2e671cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:16:13.943906 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-941ab8e7-a1ca-4bd7-859a-47e9eee04edb tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.553623 May 26 17:16:13.944553 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 775/1531] 10.222.0.112 () {60 vars in 1151 bytes} [Thu May 26 17:16:13 2022] POST /compute/v2.1/servers => generated 382 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:16:13.956212 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-ffb948e7-5473-4e50-9911-fe30274542c1 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:13.956833 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-ffb948e7-5473-4e50-9911-fe30274542c1 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:13.959103 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:13.960037 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:14.016951 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-ffb948e7-5473-4e50-9911-fe30274542c1 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:14.021785 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-ffb948e7-5473-4e50-9911-fe30274542c1 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1223 microversion: 2.1 time: 0.069382 May 26 17:16:14.022584 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 757/1532] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:13 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1223 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:15.040009 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ba3f82ef-b29e-4dda-b50f-df5793b16d1a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:15.041873 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ba3f82ef-b29e-4dda-b50f-df5793b16d1a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:15.048737 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba3f82ef-b29e-4dda-b50f-df5793b16d1a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:15.049476 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba3f82ef-b29e-4dda-b50f-df5793b16d1a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:15.049940 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba3f82ef-b29e-4dda-b50f-df5793b16d1a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:15.050477 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ba3f82ef-b29e-4dda-b50f-df5793b16d1a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:15.111868 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ba3f82ef-b29e-4dda-b50f-df5793b16d1a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:15.120602 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ba3f82ef-b29e-4dda-b50f-df5793b16d1a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1227 microversion: 2.1 time: 0.085077 May 26 17:16:15.121166 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 776/1533] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:15 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1227 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:16.138339 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-4579815b-15bf-4695-9740-76ab27e9665d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:16.139004 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-4579815b-15bf-4695-9740-76ab27e9665d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:16.146389 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4579815b-15bf-4695-9740-76ab27e9665d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:16.146865 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4579815b-15bf-4695-9740-76ab27e9665d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:16.147620 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4579815b-15bf-4695-9740-76ab27e9665d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:16.148054 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-4579815b-15bf-4695-9740-76ab27e9665d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:16.210358 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-4579815b-15bf-4695-9740-76ab27e9665d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:16.219744 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-4579815b-15bf-4695-9740-76ab27e9665d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1293 microversion: 2.1 time: 0.086590 May 26 17:16:16.220361 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 758/1534] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:16 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:17.087152 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:16:17.087357 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Thu May 26 17:16:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:16:17.236970 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-c3ac7bbc-9d79-49ed-a308-1de8b2131988 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:17.237665 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-c3ac7bbc-9d79-49ed-a308-1de8b2131988 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:17.244330 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c3ac7bbc-9d79-49ed-a308-1de8b2131988 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:17.244672 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c3ac7bbc-9d79-49ed-a308-1de8b2131988 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:17.245440 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c3ac7bbc-9d79-49ed-a308-1de8b2131988 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:17.245880 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-c3ac7bbc-9d79-49ed-a308-1de8b2131988 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:17.377486 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-c3ac7bbc-9d79-49ed-a308-1de8b2131988 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:17.385924 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-c3ac7bbc-9d79-49ed-a308-1de8b2131988 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1323 microversion: 2.1 time: 0.152639 May 26 17:16:17.386899 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 777/1535] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:17 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1323 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:17.747186 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-da27fe51-d120-474f-b2cd-b60681efb08f req-9b329731-fe81-4eec-b392-391057504a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df9238df-402e-43c9-b2ff-698a197adaeb", "tag": "80cca95a-14ee-488a-ac28-fd00fa968b36"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:16:17.755507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-da27fe51-d120-474f-b2cd-b60681efb08f req-9b329731-fe81-4eec-b392-391057504a87 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:17.755996 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-da27fe51-d120-474f-b2cd-b60681efb08f req-9b329731-fe81-4eec-b392-391057504a87 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:17.767470 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-da27fe51-d120-474f-b2cd-b60681efb08f req-9b329731-fe81-4eec-b392-391057504a87 service nova] Creating event network-changed:80cca95a-14ee-488a-ac28-fd00fa968b36 for instance df9238df-402e-43c9-b2ff-698a197adaeb on hv-cinder-83607 May 26 17:16:17.772635 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-da27fe51-d120-474f-b2cd-b60681efb08f req-9b329731-fe81-4eec-b392-391057504a87 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153523 May 26 17:16:17.773234 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 759/1536] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:16:18.403358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-136f0dae-00d6-4b3b-b828-257a86090f01 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:18.404005 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-136f0dae-00d6-4b3b-b828-257a86090f01 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:18.410595 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-136f0dae-00d6-4b3b-b828-257a86090f01 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:18.411049 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-136f0dae-00d6-4b3b-b828-257a86090f01 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:18.411820 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-136f0dae-00d6-4b3b-b828-257a86090f01 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:18.412256 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-136f0dae-00d6-4b3b-b828-257a86090f01 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:18.545963 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-136f0dae-00d6-4b3b-b828-257a86090f01 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:18.553349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-136f0dae-00d6-4b3b-b828-257a86090f01 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1323 microversion: 2.1 time: 0.154011 May 26 17:16:18.553907 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 778/1537] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:18 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:19.571546 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-bafb4021-14b6-4b77-8a45-450b93ebbd4b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:19.572178 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-bafb4021-14b6-4b77-8a45-450b93ebbd4b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:19.579447 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bafb4021-14b6-4b77-8a45-450b93ebbd4b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:19.579894 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bafb4021-14b6-4b77-8a45-450b93ebbd4b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:19.580651 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bafb4021-14b6-4b77-8a45-450b93ebbd4b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:19.581085 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-bafb4021-14b6-4b77-8a45-450b93ebbd4b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:19.710684 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-bafb4021-14b6-4b77-8a45-450b93ebbd4b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:19.719168 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-bafb4021-14b6-4b77-8a45-450b93ebbd4b tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1323 microversion: 2.1 time: 0.151910 May 26 17:16:19.719728 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 760/1538] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:19 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1323 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:20.737005 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-0726ccb8-9f1a-4d9b-894f-ec2595f1672a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:20.737613 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-0726ccb8-9f1a-4d9b-894f-ec2595f1672a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:20.745119 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0726ccb8-9f1a-4d9b-894f-ec2595f1672a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:20.745575 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0726ccb8-9f1a-4d9b-894f-ec2595f1672a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:20.746365 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0726ccb8-9f1a-4d9b-894f-ec2595f1672a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:20.746807 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-0726ccb8-9f1a-4d9b-894f-ec2595f1672a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:20.873976 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-0726ccb8-9f1a-4d9b-894f-ec2595f1672a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:20.881434 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-0726ccb8-9f1a-4d9b-894f-ec2595f1672a tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1323 microversion: 2.1 time: 0.148254 May 26 17:16:20.882052 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 779/1539] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:20 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1323 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:21.899132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-b12557c4-5355-4e22-9d60-cd3592e535c2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:21.899759 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-b12557c4-5355-4e22-9d60-cd3592e535c2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:21.907010 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b12557c4-5355-4e22-9d60-cd3592e535c2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:21.910507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b12557c4-5355-4e22-9d60-cd3592e535c2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:21.910507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b12557c4-5355-4e22-9d60-cd3592e535c2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:21.910507 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-b12557c4-5355-4e22-9d60-cd3592e535c2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:22.035293 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-b12557c4-5355-4e22-9d60-cd3592e535c2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:22.042961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-b12557c4-5355-4e22-9d60-cd3592e535c2 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1323 microversion: 2.1 time: 0.147774 May 26 17:16:22.043522 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 761/1540] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:21 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1323 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:23.059172 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-b311030b-2b6a-48bb-948b-5358b60514b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:23.059712 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-b311030b-2b6a-48bb-948b-5358b60514b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:23.066180 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b311030b-2b6a-48bb-948b-5358b60514b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:23.066658 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b311030b-2b6a-48bb-948b-5358b60514b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:23.067458 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b311030b-2b6a-48bb-948b-5358b60514b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:23.067896 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-b311030b-2b6a-48bb-948b-5358b60514b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:23.201927 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-b311030b-2b6a-48bb-948b-5358b60514b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:23.209694 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-b311030b-2b6a-48bb-948b-5358b60514b9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1323 microversion: 2.1 time: 0.154325 May 26 17:16:23.210268 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 780/1541] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:23 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:24.227438 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-8bf88936-b804-4bc3-b18d-1be3bfbde376 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:24.228040 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-8bf88936-b804-4bc3-b18d-1be3bfbde376 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:24.230586 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell0:SELECT=2 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:24.235618 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8bf88936-b804-4bc3-b18d-1be3bfbde376 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:24.236070 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8bf88936-b804-4bc3-b18d-1be3bfbde376 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:24.236843 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8bf88936-b804-4bc3-b18d-1be3bfbde376 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:24.237281 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-8bf88936-b804-4bc3-b18d-1be3bfbde376 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:24.628527 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-8bf88936-b804-4bc3-b18d-1be3bfbde376 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:24.635967 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-8bf88936-b804-4bc3-b18d-1be3bfbde376 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1323 microversion: 2.1 time: 0.412330 May 26 17:16:24.636538 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 762/1542] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:24 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1323 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:25.652564 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-6f22b100-0dc2-438c-bcc7-4bde2780c640 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:25.653171 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-6f22b100-0dc2-438c-bcc7-4bde2780c640 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:25.655005 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=2 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:25.655660 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell0:SELECT=6 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:25.660408 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6f22b100-0dc2-438c-bcc7-4bde2780c640 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:25.660846 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6f22b100-0dc2-438c-bcc7-4bde2780c640 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:25.661601 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6f22b100-0dc2-438c-bcc7-4bde2780c640 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:25.662030 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-6f22b100-0dc2-438c-bcc7-4bde2780c640 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:25.751438 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [req-e430d43a-b3a3-4d2e-bdd5-378d93f74169 req-ab07de0e-9549-4d08-a66a-dfc50e695f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9238df-402e-43c9-b2ff-698a197adaeb", "name": "network-vif-plugged", "status": "completed", "tag": "80cca95a-14ee-488a-ac28-fd00fa968b36"}]} {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:16:25.761888 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-e430d43a-b3a3-4d2e-bdd5-378d93f74169 req-ab07de0e-9549-4d08-a66a-dfc50e695f91 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:25.762650 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [req-e430d43a-b3a3-4d2e-bdd5-378d93f74169 req-ab07de0e-9549-4d08-a66a-dfc50e695f91 service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:25.775660 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.compute.server_external_events [req-e430d43a-b3a3-4d2e-bdd5-378d93f74169 req-ab07de0e-9549-4d08-a66a-dfc50e695f91 service nova] Creating event network-vif-plugged:80cca95a-14ee-488a-ac28-fd00fa968b36 for instance df9238df-402e-43c9-b2ff-698a197adaeb on hv-cinder-83607 May 26 17:16:25.781690 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [req-e430d43a-b3a3-4d2e-bdd5-378d93f74169 req-ab07de0e-9549-4d08-a66a-dfc50e695f91 service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034536 May 26 17:16:25.782771 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 763/1543] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:16:25.815908 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-6f22b100-0dc2-438c-bcc7-4bde2780c640 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:25.824949 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-6f22b100-0dc2-438c-bcc7-4bde2780c640 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1323 microversion: 2.1 time: 0.176118 May 26 17:16:25.825545 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 781/1544] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:25 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1323 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:26.843679 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-2b36ed01-ea87-4576-a5e5-67eccbeff2e9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:26.844387 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-2b36ed01-ea87-4576-a5e5-67eccbeff2e9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:26.851582 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2b36ed01-ea87-4576-a5e5-67eccbeff2e9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:26.852404 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2b36ed01-ea87-4576-a5e5-67eccbeff2e9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:26.852862 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2b36ed01-ea87-4576-a5e5-67eccbeff2e9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:26.853294 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-2b36ed01-ea87-4576-a5e5-67eccbeff2e9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:26.992879 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-2b36ed01-ea87-4576-a5e5-67eccbeff2e9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:27.001243 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-2b36ed01-ea87-4576-a5e5-67eccbeff2e9 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1323 microversion: 2.1 time: 0.162502 May 26 17:16:27.001809 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 764/1545] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:26 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1323 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:28.018890 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-ee2dcc58-8f70-45e7-a4f7-ec80df7ff74d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:28.019450 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-ee2dcc58-8f70-45e7-a4f7-ec80df7ff74d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:28.025903 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee2dcc58-8f70-45e7-a4f7-ec80df7ff74d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:28.026387 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee2dcc58-8f70-45e7-a4f7-ec80df7ff74d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:28.027183 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee2dcc58-8f70-45e7-a4f7-ec80df7ff74d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:28.027747 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-ee2dcc58-8f70-45e7-a4f7-ec80df7ff74d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:28.154468 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-ee2dcc58-8f70-45e7-a4f7-ec80df7ff74d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:28.161972 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-ee2dcc58-8f70-45e7-a4f7-ec80df7ff74d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1323 microversion: 2.1 time: 0.147050 May 26 17:16:28.162571 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 782/1546] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:28 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1323 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:29.179026 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-199ad462-9d61-4d52-82cc-7d1cd6c33e66 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:29.179697 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-199ad462-9d61-4d52-82cc-7d1cd6c33e66 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:29.186138 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-199ad462-9d61-4d52-82cc-7d1cd6c33e66 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:29.186617 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-199ad462-9d61-4d52-82cc-7d1cd6c33e66 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:29.187381 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-199ad462-9d61-4d52-82cc-7d1cd6c33e66 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:29.187815 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-199ad462-9d61-4d52-82cc-7d1cd6c33e66 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:29.316023 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-199ad462-9d61-4d52-82cc-7d1cd6c33e66 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:29.323392 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-199ad462-9d61-4d52-82cc-7d1cd6c33e66 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1511 microversion: 2.1 time: 0.148252 May 26 17:16:29.324465 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 765/1547] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:29 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:29.341919 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-be131001-61d2-4ce8-b457-8c9a3a150b3c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9238669-0722-43e7-b92c-5169776512c9", "device": "/dev/sdb"}} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:16:29.343592 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-be131001-61d2-4ce8-b457-8c9a3a150b3c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:29.349965 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-be131001-61d2-4ce8-b457-8c9a3a150b3c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:29.352027 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-be131001-61d2-4ce8-b457-8c9a3a150b3c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:29.352027 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-be131001-61d2-4ce8-b457-8c9a3a150b3c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:29.352027 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-be131001-61d2-4ce8-b457-8c9a3a150b3c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:30.052417 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-be131001-61d2-4ce8-b457-8c9a3a150b3c tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "POST /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714951 May 26 17:16:30.053036 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 783/1548] 10.222.0.112 () {60 vars in 1327 bytes} [Thu May 26 17:16:29 2022] POST /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:16:55.199006 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-e15bc005-9104-4fc1-8286-5576e156cc3e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:55.199581 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-e15bc005-9104-4fc1-8286-5576e156cc3e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:55.201772 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_api:SELECT=20 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:55.202460 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG dbcounter [-] [130525] Writing DB stats nova_cell1:SELECT=40 {{(pid=130525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:55.207361 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e15bc005-9104-4fc1-8286-5576e156cc3e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:55.207811 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e15bc005-9104-4fc1-8286-5576e156cc3e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:55.208583 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e15bc005-9104-4fc1-8286-5576e156cc3e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:55.209021 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-e15bc005-9104-4fc1-8286-5576e156cc3e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:55.294626 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.objects.instance [None req-e15bc005-9104-4fc1-8286-5576e156cc3e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lazy-loading 'services' on Instance uuid df9238df-402e-43c9-b2ff-698a197adaeb {{(pid=130525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:16:55.510834 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-e15bc005-9104-4fc1-8286-5576e156cc3e tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "DELETE /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb/os-volume_attachments/f9238669-0722-43e7-b92c-5169776512c9" status: 202 len: 0 microversion: 2.1 time: 0.316938 May 26 17:16:55.511610 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 766/1549] 10.222.0.112 () {58 vars in 1420 bytes} [Thu May 26 17:16:55 2022] DELETE /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb/os-volume_attachments/f9238669-0722-43e7-b92c-5169776512c9 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:16:57.683993 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:57.684847 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG dbcounter [-] [130526] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:57.688904 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-58862c0b-5925-45d9-b4c1-85de4d797542 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:57.689492 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-58862c0b-5925-45d9-b4c1-85de4d797542 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:57.696964 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-58862c0b-5925-45d9-b4c1-85de4d797542 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:57.697410 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-58862c0b-5925-45d9-b4c1-85de4d797542 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:57.698171 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-58862c0b-5925-45d9-b4c1-85de4d797542 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:57.698639 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-58862c0b-5925-45d9-b4c1-85de4d797542 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:57.724932 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-58862c0b-5925-45d9-b4c1-85de4d797542 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Going to try to terminate instance {{(pid=130526) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:16:58.010846 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-58862c0b-5925-45d9-b4c1-85de4d797542 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "DELETE /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 204 len: 0 microversion: 2.1 time: 0.328065 May 26 17:16:58.011753 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 784/1550] 10.222.0.112 () {58 vars in 1243 bytes} [Thu May 26 17:16:57 2022] DELETE /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:16:58.020446 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-3e027624-6402-4e5a-9cb3-8d497a2daf46 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:58.025405 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-3e027624-6402-4e5a-9cb3-8d497a2daf46 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:58.027914 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3e027624-6402-4e5a-9cb3-8d497a2daf46 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:58.028351 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3e027624-6402-4e5a-9cb3-8d497a2daf46 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:58.029131 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3e027624-6402-4e5a-9cb3-8d497a2daf46 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:58.029555 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-3e027624-6402-4e5a-9cb3-8d497a2daf46 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:58.160845 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-3e027624-6402-4e5a-9cb3-8d497a2daf46 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:58.168473 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-3e027624-6402-4e5a-9cb3-8d497a2daf46 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1517 microversion: 2.1 time: 0.152276 May 26 17:16:58.169043 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 767/1551] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:58 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:16:59.185768 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-554ab2a2-2c8b-4471-971a-ec43ab167e75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:16:59.186550 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-554ab2a2-2c8b-4471-971a-ec43ab167e75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:16:59.193063 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-554ab2a2-2c8b-4471-971a-ec43ab167e75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:59.193511 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-554ab2a2-2c8b-4471-971a-ec43ab167e75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:59.194280 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-554ab2a2-2c8b-4471-971a-ec43ab167e75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:16:59.195347 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-554ab2a2-2c8b-4471-971a-ec43ab167e75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:16:59.328770 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.policy [None req-554ab2a2-2c8b-4471-971a-ec43ab167e75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130526) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:16:59.337358 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-554ab2a2-2c8b-4471-971a-ec43ab167e75 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1517 microversion: 2.1 time: 0.155846 May 26 17:16:59.337936 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 785/1552] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:16:59 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:17:00.355926 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-d0d34878-11e4-45b5-9775-eacc986d7aec tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:17:00.356541 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-d0d34878-11e4-45b5-9775-eacc986d7aec tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:17:00.363211 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d0d34878-11e4-45b5-9775-eacc986d7aec tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:17:00.363663 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d0d34878-11e4-45b5-9775-eacc986d7aec tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:17:00.364517 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d0d34878-11e4-45b5-9775-eacc986d7aec tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:17:00.364961 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-d0d34878-11e4-45b5-9775-eacc986d7aec tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:17:00.501144 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-d0d34878-11e4-45b5-9775-eacc986d7aec tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:17:00.508523 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-d0d34878-11e4-45b5-9775-eacc986d7aec tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1517 microversion: 2.1 time: 0.156580 May 26 17:17:00.510220 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 768/1553] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:17:00 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:17:01.292775 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [req-b352412a-9e48-4a92-826d-524e84a92b99 req-eba9b9f3-cf4b-4433-a009-ccba1a46c76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9238df-402e-43c9-b2ff-698a197adaeb", "name": "network-vif-deleted", "tag": "80cca95a-14ee-488a-ac28-fd00fa968b36"}]} {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:17:01.301435 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-b352412a-9e48-4a92-826d-524e84a92b99 req-eba9b9f3-cf4b-4433-a009-ccba1a46c76a service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:17:01.301872 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [req-b352412a-9e48-4a92-826d-524e84a92b99 req-eba9b9f3-cf4b-4433-a009-ccba1a46c76a service nova] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:17:01.313349 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.compute.server_external_events [req-b352412a-9e48-4a92-826d-524e84a92b99 req-eba9b9f3-cf4b-4433-a009-ccba1a46c76a service nova] Creating event network-vif-deleted:80cca95a-14ee-488a-ac28-fd00fa968b36 for instance df9238df-402e-43c9-b2ff-698a197adaeb on hv-cinder-83607 May 26 17:17:01.318707 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [req-b352412a-9e48-4a92-826d-524e84a92b99 req-eba9b9f3-cf4b-4433-a009-ccba1a46c76a service nova] 10.222.0.112 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030498 May 26 17:17:01.320597 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 786/1554] 10.222.0.112 () {64 vars in 1322 bytes} [Thu May 26 17:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:17:01.525139 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.api.openstack.wsgi [None req-f6d1bc3b-01a9-42f2-80c8-a61868c48c2d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:17:01.525732 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.compute.api [None req-f6d1bc3b-01a9-42f2-80c8-a61868c48c2d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130525) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:17:01.532132 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f6d1bc3b-01a9-42f2-80c8-a61868c48c2d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:17:01.532587 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f6d1bc3b-01a9-42f2-80c8-a61868c48c2d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:17:01.533360 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f6d1bc3b-01a9-42f2-80c8-a61868c48c2d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:17:01.533801 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG oslo_concurrency.lockutils [None req-f6d1bc3b-01a9-42f2-80c8-a61868c48c2d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:17:01.596363 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: DEBUG nova.policy [None req-f6d1bc3b-01a9-42f2-80c8-a61868c48c2d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fa321f3ac1448681e4191ff04b47a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bbc230c5914635ba995b16e43059f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130525) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:17:01.604394 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO nova.api.openstack.requestlog [None req-f6d1bc3b-01a9-42f2-80c8-a61868c48c2d tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 200 len: 1308 microversion: 2.1 time: 0.083256 May 26 17:17:01.605801 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: [pid: 130525|app: 0|req: 769/1555] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:17:01 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 1308 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:17:02.622247 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-410f1c74-acd7-4da2-9ac8-1d8176af07f5 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Calling method '>' {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:17:02.622982 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.compute.api [None req-410f1c74-acd7-4da2-9ac8-1d8176af07f5 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] [instance: df9238df-402e-43c9-b2ff-698a197adaeb] Fetching instance by UUID {{(pid=130526) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:17:02.629574 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-410f1c74-acd7-4da2-9ac8-1d8176af07f5 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:17:02.630024 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-410f1c74-acd7-4da2-9ac8-1d8176af07f5 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:17:02.630815 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-410f1c74-acd7-4da2-9ac8-1d8176af07f5 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:17:02.631252 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG oslo_concurrency.lockutils [None req-410f1c74-acd7-4da2-9ac8-1d8176af07f5 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Lock "e260859a-6023-4cf2-a86b-d32d2bdb7fbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:17:02.644255 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.wsgi [None req-410f1c74-acd7-4da2-9ac8-1d8176af07f5 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] HTTP exception thrown: Instance df9238df-402e-43c9-b2ff-698a197adaeb could not be found. May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-410f1c74-acd7-4da2-9ac8-1d8176af07f5 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Request method failure captured: May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: request: GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb HTTP/1.1 May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept: application/json May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Accept-Encoding: identity May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Connection: close May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Length: 0 May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Content-Type: application/json May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Host: 10.222.0.112 May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Openstack-System-Scope: None May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: User-Agent: python-urllib3/1.26.9 May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Auth-Token: gAAAAABij7Vmk1Hp0Z2ehpTP50yukMtlHrQ35WFN0KEqoVFadsw4EOPylgN12DCXWtAZNJrZlO04J79DATr6fd_RmHSsN3dB-GTVS1SS5WZC3nTCs96GAQ3VzfEbyD1sKZ6PciNMx5cNN451UwGNdmr1faDwW-YwG__snC1LUOOMpcJ6VBF7Fsg May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Id: None May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Domain-Name: None May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Identity-Status: Confirmed May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Is-Admin-Project: True May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Id: default May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Domain-Name: Default May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Id: b3bbc230c5914635ba995b16e43059f7 May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1208611973 May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Role: reader,member May 26 17:17:02.645877 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Roles: reader,member May 26 17:17:02.648353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/b3bbc230c5914635ba995b16e43059f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2/b3bbc230c5914635ba995b16e43059f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/volume/v3/b3bbc230c5914635ba995b16e43059f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.112/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.112:8080", "publicURL": "http://10.222.0.112:8080/v1/AUTH_b3bbc230c5914635ba995b16e43059f7"}]}] May 26 17:17:02.648353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant: tempest-VolumesSnapshotTestJSON-1208611973 May 26 17:17:02.648353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Id: b3bbc230c5914635ba995b16e43059f7 May 26 17:17:02.648353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1208611973 May 26 17:17:02.648353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User: tempest-VolumesSnapshotTestJSON-1208611973-project May 26 17:17:02.648353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Id: default May 26 17:17:02.648353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Domain-Name: Default May 26 17:17:02.648353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Id: 80fa321f3ac1448681e4191ff04b47a2 May 26 17:17:02.648353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: X-User-Name: tempest-VolumesSnapshotTestJSON-1208611973-project May 26 17:17:02.648353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: method: > May 26 17:17:02.648353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: exception: Instance df9238df-402e-43c9-b2ff-698a197adaeb could not be found. May 26 17:17:02.648353 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: action_args: {'id': 'df9238df-402e-43c9-b2ff-698a197adaeb'} May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: {{(pid=130526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df9238df-402e-43c9-b2ff-698a197adaeb could not be found. May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:17:02.649626 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df9238df-402e-43c9-b2ff-698a197adaeb could not be found. May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df9238df-402e-43c9-b2ff-698a197adaeb could not be found. May 26 17:17:02.651533 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: ERROR nova.api.openstack.wsgi May 26 17:17:02.653210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: DEBUG nova.api.openstack.wsgi [None req-410f1c74-acd7-4da2-9ac8-1d8176af07f5 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] Returning 404 to user: Instance df9238df-402e-43c9-b2ff-698a197adaeb could not be found. {{(pid=130526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:17:02.653210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO nova.api.openstack.requestlog [None req-410f1c74-acd7-4da2-9ac8-1d8176af07f5 tempest-VolumesSnapshotTestJSON-1208611973 tempest-VolumesSnapshotTestJSON-1208611973-project] 10.222.0.112 "GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb" status: 404 len: 111 microversion: 2.1 time: 0.029313 May 26 17:17:02.653210 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: [pid: 130526|app: 0|req: 787/1556] 10.222.0.112 () {58 vars in 1240 bytes} [Thu May 26 17:17:02 2022] GET /compute/v2.1/servers/df9238df-402e-43c9-b2ff-698a197adaeb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:17:55.223551 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:17:55.226595 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Thu May 26 17:17:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:18:04.435852 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:18:04.436368 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Thu May 26 17:18:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:19:37.097124 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:19:37.097614 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Thu May 26 17:19:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:20:12.778295 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:20:12.779062 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Thu May 26 17:20:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:20:14.989294 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:20:14.989916 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Thu May 26 17:20:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:21:15.232065 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:21:15.232578 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Thu May 26 17:21:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:21:24.446825 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:21:24.447464 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Thu May 26 17:21:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:21:46.645463 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:21:46.646130 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Thu May 26 17:21:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:22:57.107570 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:22:57.108155 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Thu May 26 17:22:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:23:32.787785 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:23:32.788536 dv-cinder-836072-5-iscsi devstack@n-api.service[130525]: Thu May 26 17:23:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:23:34.998480 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:23:34.999110 dv-cinder-836072-5-iscsi devstack@n-api.service[130526]: Thu May 26 17:23:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!